-- Logs begin at Tue 2022-03-29 15:18:08 UTC, end at Tue 2022-03-29 16:31:13 UTC. -- Mar 29 15:43:19.806814 dv-cinder-808995-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 29 15:43:19.814174 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 29 15:43:19 2022] *** Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: nodename: dv-cinder-808995-2-iscsi Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: machine: x86_64 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: clock source: unix Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: pcre jit disabled Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: detected number of CPU cores: 4 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: current working directory: / Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: detected binary path: /usr/bin/uwsgi-core Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: your processes number limit is 47680 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: your memory page size is 4096 bytes Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: detected max file descriptor number: 2048 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: lock engine: pthread robust mutexes Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: thunder lock: enabled Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 29 15:43:19.820982 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 29 15:43:19.865965 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: Python main interpreter initialized at 0x5576496579c0 Mar 29 15:43:19.865965 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: python threads support enabled Mar 29 15:43:19.865965 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: your server socket listen backlog is limited to 100 connections Mar 29 15:43:19.865965 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: your mercy for graceful operations on workers is 90 seconds Mar 29 15:43:19.866326 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: mapped 403077 bytes (393 KB) for 2 cores Mar 29 15:43:19.866383 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: *** Operational MODE: preforking *** Mar 29 15:43:19.866687 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: *** uWSGI is running in multiple interpreter mode *** Mar 29 15:43:19.866687 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: spawned uWSGI master process (pid: 79725) Mar 29 15:43:19.866891 dv-cinder-808995-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 29 15:43:19.869181 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: spawned uWSGI worker 1 (pid: 79739, cores: 1) Mar 29 15:43:19.869181 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: spawned uWSGI worker 2 (pid: 79740, cores: 1) Mar 29 15:43:19.869181 dv-cinder-808995-2-iscsi devstack@keystone.service[79725]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 29 15:43:25.679995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 15:43:25.679995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: from cryptography.utils import int_from_bytes Mar 29 15:43:25.680771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 15:43:25.680771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: from cryptography.utils import int_from_bytes Mar 29 15:43:25.680885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 15:43:25.680885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: from cryptography.utils import int_from_bytes Mar 29 15:43:25.680885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 15:43:25.680885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: from cryptography.utils import int_from_bytes Mar 29 15:43:25.726038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 15:43:25.726283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 15:43:25.726367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 15:43:25.726448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] command line args: [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 15:43:25.726521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 15:43:25.726682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 15:43:25.726762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] command line args: [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 15:43:25.726828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ================================================================================ {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 15:43:25.726971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 15:43:25.727056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] admin_token = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ================================================================================ {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 15:43:25.727297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] config_dir = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] admin_token = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] config_dir = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] config_source = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.727852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] debug = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.728024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] config_source = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.728105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] debug = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.730975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_config_append = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_config_append = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_dir = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_dir = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_file = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_file = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.731975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.732980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.733048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.733107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.733177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.733239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.733303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.733361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.734051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.734270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.734476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.734684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.734888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] publish_errors = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.735089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] publish_errors = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.735304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.735504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.735704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.735898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.736091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.736284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.736521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.736776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.736969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.737163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.737390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] standard_threads = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.737598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] standard_threads = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.737765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.737992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.738210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.738411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.738581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.738817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.738984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] use_journal = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.739148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] use_journal = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.739282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] use_json = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.739454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] use_json = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.739624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] use_stderr = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.739902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] use_stderr = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.740060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] use_syslog = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.740194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] use_syslog = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.740330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.740503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 15:43:25.740674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.740816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.740953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.741896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.742907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.743891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.744970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.745899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.746972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.747930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748391 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.748990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.749917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.750975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.751945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.752883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.753013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.753141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.753276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.753406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.754635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.754855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.755024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.755220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.755414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.755709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.755876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.756111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.756280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.756545 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.756746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.756941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.757137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.757380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.757549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.757744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.757973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.758176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.758346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.758578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.758778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.758947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.759141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.759334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.759627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.759811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.759997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.760162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.760311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.760443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.760610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.760755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.760896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.761869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.762518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.762683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.762826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.762958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.763953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.764894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.765968 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766237 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.766908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.767874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.768936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.769923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.770863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.771896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.external = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.772973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.external = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.773937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.password = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] auth.token = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.password = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] auth.token = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.774866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.775866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.776942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.777081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.777215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.777346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.777479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.777609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.778298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.778445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.778586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.778719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.778850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.778980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.779971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.780114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.780257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.780387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.780524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.780658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.781362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.781501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.781635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.781838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.781985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.782120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.782379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.782532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.782675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.782820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.782952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.783084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.783290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.783426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.783588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.783736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.783872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.784954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.785898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.786979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.787968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788693 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.788962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.789888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.790959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.791915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.792993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.793126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.793282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.793920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.794996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.795969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.796233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.797881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.798948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.799937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.800875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.801960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.802883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803790 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.803933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.804878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.805948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.806874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.807989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.808978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.809995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.810923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.811920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] role.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] role.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.812992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813534 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] role.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] role.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.813939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.814884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.815921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.816866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.817910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.818984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.819938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.820885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.821976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.822920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823322 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.823949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.824091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.824233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.824367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.825979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.826978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.827116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.827261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.827401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.827607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.827607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.827879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.connection = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.connection = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.828879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.829977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.830948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.831094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.831234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.831373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.831510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.831683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.831828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.832904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.833045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.833045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 15:43:25.833306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.833306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.833306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 15:43:25.833306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 15:43:25.842778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.843011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.843274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.843437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.843639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.843954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.851979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.852455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.881621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.882043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.882209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.882376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.939576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.939748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.989841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.990077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.990670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:25.990909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.056376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.056603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.056831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.056917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.057916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.083140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.083371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.083551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.083641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.083788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.083873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.084885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.096297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.096399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.109678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.109911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.109996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.110884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.111017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79739) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.111103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.111228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79740) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 29 15:43:26.128923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.129137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 15:43:26.129332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.129476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.129561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 15:43:26.129679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 15:43:26.129867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.129951 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.130069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 29 15:43:26.130194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.130336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.130451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.130594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.130705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.130850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.131102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.141251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.141528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.141795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.141891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.142078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.142173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.142382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.142657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.150124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.150655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.153889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.154170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.154370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.154467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.154647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.154732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.154924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.155845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156634 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.156813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.157075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.182902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.183224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.184958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.185236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.185321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.185587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.190413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.190672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.190767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.191030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.191114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.191326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.198151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.198398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.198485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.198678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.202834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.203089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.203184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.203370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.203456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.203676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.203799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.203954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.204840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.205021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.223844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.223974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.224117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.224250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.228513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.228726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.232079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.232368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.232467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.232768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.237557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.237692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.241058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.241260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.244565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.244841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.244926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.245953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.246040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.246232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.265428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.265574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.265723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.265855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.265982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.266111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.266287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.266432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.273805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.274112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.275465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.275758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.275887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.276068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.279354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.279662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.279798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.279938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.280068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.280212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.280341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.280493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.280624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.280805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.293472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.293746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.293879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.294019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.294163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.294293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.294423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.294648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.295856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.296148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.296280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.296436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.296567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.296788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.314798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.314944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.318000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.318135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.321225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.321375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.423909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.424360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.425558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.425840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.425992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.426144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.426275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.426541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.433260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.433681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.435376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.436087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.438711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.439008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.439291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.439429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.439600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.439727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.439982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.440257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.448626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.448828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.449105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.449233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.449416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.449732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.456849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79739) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.457133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.457426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79740) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 29 15:43:26.457555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.457705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.457834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458164 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.458999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.459135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.459323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.459452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.459663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.459795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.459922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79739) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.460978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79740) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 29 15:43:26.498024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576496579c0 pid: 79739 (default app) Mar 29 15:43:26.498668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5576496579c0 pid: 79740 (default app) Mar 29 15:43:26.501477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6fe48-6eba-4a19-b9b2-2cde2f091aad None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:26.501772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6fe48-6eba-4a19-b9b2-2cde2f091aad None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:26.502058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6fe48-6eba-4a19-b9b2-2cde2f091aad None None] PATH_INFO: `/v3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:26.506222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue Mar 29 15:43:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:34.728261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e762c4-2136-4e2a-816b-40d7b8bee8a7 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:34.728838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e762c4-2136-4e2a-816b-40d7b8bee8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:34.728838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e762c4-2136-4e2a-816b-40d7b8bee8a7 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:34.734448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:43:34.739694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:34.740112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:34.740282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:34.771042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG oslo_db.sqlalchemy.engines [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 29 15:43:34.958204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG passlib.handlers.bcrypt [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79739) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 29 15:43:34.958614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG passlib.handlers.bcrypt [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79739) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 29 15:43:35.014253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:35.016433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:35.142976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 29 15:43:35.294434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e762c4-2136-4e2a-816b-40d7b8bee8a7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:35.328384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG oslo_db.sqlalchemy.engines [None req-57e762c4-2136-4e2a-816b-40d7b8bee8a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 29 15:43:35.460649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e762c4-2136-4e2a-816b-40d7b8bee8a7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:35.465443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:35.466364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:35.466655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:35.466940 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:35.475008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:35.524724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 29 15:43:35.525068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f306b4e-fa30-4258-abb9-bc16f888c865 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:35.534429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Mar 29 15:43:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 15:43:35.540605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:35.555273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791d8ca-499f-4e9b-a79b-eda261bcb0cc None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:35.560258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:35.561723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:35.562218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:35.562700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] PATH_INFO: `/v3/projects/8676a22b20704599967d071e06718ce0` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:35.565095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] RBAC: Authorizing `identity:get_project(project_id=8676a22b20704599967d071e06718ce0)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:35.617253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.common.rbac_enforcer.enforcer [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 29 15:43:35.617595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128623ee-8dc2-4a8b-b667-38e3e1f3cd43 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:35.622712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue Mar 29 15:43:35 2022] GET /identity/v3/projects/8676a22b20704599967d071e06718ce0 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:37.891406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6100-3ccf-4f45-8468-db230c0ac91d None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:37.891926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6100-3ccf-4f45-8468-db230c0ac91d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:37.892026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6100-3ccf-4f45-8468-db230c0ac91d None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:37.896514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:37.901878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:37.902250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:37.902458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:37.921669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:37.923214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:37.931005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 29 15:43:37.953987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6100-3ccf-4f45-8468-db230c0ac91d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:37.966310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6100-3ccf-4f45-8468-db230c0ac91d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:37.970452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccf5a7-f448-48da-b9cc-c44fdafe4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:37.971080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccf5a7-f448-48da-b9cc-c44fdafe4d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:37.971369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccf5a7-f448-48da-b9cc-c44fdafe4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:37.971679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccf5a7-f448-48da-b9cc-c44fdafe4d51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:37.979152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccf5a7-f448-48da-b9cc-c44fdafe4d51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:37.981481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccf5a7-f448-48da-b9cc-c44fdafe4d51 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:37.990104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Mar 29 15:43:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 15:43:37.995588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:38.004753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245ad88-4664-4fd2-8f81-351b539b4b87 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:38.009027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409232ed-7446-4561-ab38-a303d86f80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:38.009875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409232ed-7446-4561-ab38-a303d86f80eb admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:38.010160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409232ed-7446-4561-ab38-a303d86f80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:38.010432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409232ed-7446-4561-ab38-a303d86f80eb admin admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:38.011863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409232ed-7446-4561-ab38-a303d86f80eb admin admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:38.013719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409232ed-7446-4561-ab38-a303d86f80eb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:38.015186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue Mar 29 15:43:37 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:40.319222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7f6bf-ec88-447f-891a-4451f98bef7d None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.319785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7f6bf-ec88-447f-891a-4451f98bef7d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.319785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7f6bf-ec88-447f-891a-4451f98bef7d None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.321700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:40.326970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.327365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.327692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.344753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:40.345923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:40.415148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099c90-6fae-46dd-a85e-5b5d68e690a3 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.415440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099c90-6fae-46dd-a85e-5b5d68e690a3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.415749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c099c90-6fae-46dd-a85e-5b5d68e690a3 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.417554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:43:40.422605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.422728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:40.422952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.423238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.445881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:40.464337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG passlib.handlers.bcrypt [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79740) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 29 15:43:40.464756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG passlib.handlers.bcrypt [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79740) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 29 15:43:40.511784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:40.513350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:40.539004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57998b-a87e-4358-b6c3-7a2be3e0a767 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:40.570526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:40.571252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.571561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.571843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.583001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:40.589973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:43:40.591645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 7/13] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:43:40.597099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:40.607408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:43:40.629823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:40.688504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa007f-3bdd-4a66-bab9-ea1efc11a822 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:40.721529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:40.722189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.722478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.722761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.723171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08210229-0ad1-4db6-ae07-a9ce8ba4526d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:40.723510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:40.723854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:40.725241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:40.736514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:40.742049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:40.755930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:40.756832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.757121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.757402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.821755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:40.823219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:40.835004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b3cc-53f1-406b-9ee9-237560de90ab None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:40.866448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:40.867313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:40.867631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:40.867914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:40.869102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:40.871126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:40.872928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 9/16] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:40 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:40.881313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:40.924820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 8/17] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:43:40.930440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:40.975416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e5260-a107-4afb-95bd-0445fba85362 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:41.006985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:41.007793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:41.008084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:41.008364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:41.009534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:41.011018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:41.012766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:41.018173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:41.022655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f43ca-d03a-4d37-8d86-47a8a1ef25c5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:41.054536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:41.055324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:41.055648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:41.055931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:41.074693 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:41.076136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:41.093310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:43:41.094504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:43:41.100271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:41.111644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d4bfb-2c3d-4f0a-8c55-ee597e1aa61c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:41.143675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:41.144333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:41.144621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:41.144902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:41.145729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.domain.id=default, user.id=dd0ca27a61b54e5fb3070d05e2a206c1) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:41.146045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:41.147495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d255e-01c4-4ef1-a1b5-74bd5d899729 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:41.153927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Mar 29 15:43:41 2022] GET /identity/v3/role_assignments?user.id=dd0ca27a61b54e5fb3070d05e2a206c1&scope.domain.id=default&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:41.196006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709eb9-6314-4672-a338-5dda17a266b2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:41.236876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:41.237550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:41.237839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:41.238122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:41.238868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:41.239178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:41.240632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798c45-4ce9-415e-badb-185262ce9a34 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:41.259082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:43.663330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5031e-6603-4732-ab89-615d7fcf1dc8 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:43.664379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5031e-6603-4732-ab89-615d7fcf1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:43.664880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5031e-6603-4732-ab89-615d7fcf1dc8 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:43.667139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:43.672839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f867-2d9b-48e5-bb4f-9f11e4d85cf5 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:43.673749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f867-2d9b-48e5-bb4f-9f11e4d85cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:43.674226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353f867-2d9b-48e5-bb4f-9f11e4d85cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:43.700569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f353f867-2d9b-48e5-bb4f-9f11e4d85cf5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:43.701782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f353f867-2d9b-48e5-bb4f-9f11e4d85cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:43.790226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 11/23] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:43:43.825344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5031e-6603-4732-ab89-615d7fcf1dc8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:43.853906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860b48-ed30-425a-ac44-07a2e6513047 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:43.854241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860b48-ed30-425a-ac44-07a2e6513047 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:43.855016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d860b48-ed30-425a-ac44-07a2e6513047 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:43.857143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:43:43.872018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:43.872402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:43.872581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:43.908653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:43.910115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:43.956984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5031e-6603-4732-ab89-615d7fcf1dc8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:44.019745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:44.020811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.021249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.021689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.029833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:43:44.036108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:44.043823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:43:44.045494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 13/26] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:43:44.052617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.062257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.207727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4b32-0aec-476a-b5f6-46b20644e4e3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:44.266510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c2329-02e3-44be-bc0e-028081766279 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:44.286572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:44.287258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.287555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.287856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.289080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:44.289553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:44.291356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:44.304425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 14/27] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:44.312586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.321981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:44.322965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.323510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.323966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.335719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:44.337370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:44.361013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:43:44.365682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:43:44.372283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.493165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d88a-a3b7-4d16-84b2-db745baac4e1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:44.543570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46126292-dd63-4de9-ae56-c83344f8a85a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:44.555442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610702e2-2151-49ab-9d01-5754409221d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:44.556356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610702e2-2151-49ab-9d01-5754409221d1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.556638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610702e2-2151-49ab-9d01-5754409221d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.556914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610702e2-2151-49ab-9d01-5754409221d1 None admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.560131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610702e2-2151-49ab-9d01-5754409221d1 None admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:44.561592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610702e2-2151-49ab-9d01-5754409221d1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:44.565147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 15/29] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:44 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:44.566359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb25e8-0b56-4b21-8a5d-5f283bbcc497 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.566641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb25e8-0b56-4b21-8a5d-5f283bbcc497 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.566916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb25e8-0b56-4b21-8a5d-5f283bbcc497 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.573039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:44.574593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb25e8-0b56-4b21-8a5d-5f283bbcc497 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.615047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:44.616164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.618070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.618651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.621038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:44.621582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:44.623257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddd851-b810-461c-a142-86044db8dd9a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:44.652658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:44.658771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.659315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.659813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.680979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:44.683477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:44.779559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb25e8-0b56-4b21-8a5d-5f283bbcc497 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:44.791777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:44.792994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.849507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:44.850595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:44.851046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:44.851458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:44.853040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:44.857113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:44.865454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:44.866529 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:44.983306 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff219-ca5d-4c08-b13a-d855d73aa94e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:45.026009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:45.027427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.027873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.028314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.029158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:45.030749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:45.032798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc0fe-28a0-428d-8828-a032a4f37998 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:45.068215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0877198-bdca-4667-9664-71ad060431ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:45.068893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877198-bdca-4667-9664-71ad060431ec None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.069230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877198-bdca-4667-9664-71ad060431ec None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.069554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0877198-bdca-4667-9664-71ad060431ec None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.070352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0877198-bdca-4667-9664-71ad060431ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:45.071912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0877198-bdca-4667-9664-71ad060431ec None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:45.175272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 17/34] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:43:44 2022] POST /identity/v3/projects => generated 301 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:43:45.184939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:45.206899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 18/35] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Mar 29 15:43:44 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:43:45.208934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567c70-b907-4d21-a0a4-f02356bb2ca4 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.209207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567c70-b907-4d21-a0a4-f02356bb2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.209694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12567c70-b907-4d21-a0a4-f02356bb2ca4 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.216524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:45.219939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69e69-beae-4375-807d-059a580879d6 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.220250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69e69-beae-4375-807d-059a580879d6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.220597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69e69-beae-4375-807d-059a580879d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.250942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-62c69e69-beae-4375-807d-059a580879d6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:45.253275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-62c69e69-beae-4375-807d-059a580879d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:45.375552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:43:45.420945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69e69-beae-4375-807d-059a580879d6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:45.435326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e33f4-a6d1-4d82-b083-14906b25c454 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:45.509287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c34a4-a0b6-4171-952e-cfc4db0b6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:45.510487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c34a4-a0b6-4171-952e-cfc4db0b6ca4 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.511445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c34a4-a0b6-4171-952e-cfc4db0b6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.511902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c34a4-a0b6-4171-952e-cfc4db0b6ca4 None admin] PATH_INFO: `/v3/domains/default/users/dd0ca27a61b54e5fb3070d05e2a206c1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.514301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c34a4-a0b6-4171-952e-cfc4db0b6ca4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dd0ca27a61b54e5fb3070d05e2a206c1, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:45.516077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c34a4-a0b6-4171-952e-cfc4db0b6ca4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:45.545685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 18/38] 10.222.0.23 () {58 vars in 1361 bytes} [Tue Mar 29 15:43:45 2022] PUT /identity/v3/domains/default/users/dd0ca27a61b54e5fb3070d05e2a206c1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:43:45.547432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7d4d-0af7-49e2-bb90-0e0bb5da9a31 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.551969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7d4d-0af7-49e2-bb90-0e0bb5da9a31 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.552297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7d4d-0af7-49e2-bb90-0e0bb5da9a31 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.554405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 19/39] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:45.555489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236f24-d5a0-4eb1-b459-bce340af673b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.555796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236f24-d5a0-4eb1-b459-bce340af673b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.556119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236f24-d5a0-4eb1-b459-bce340af673b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.558391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 20/40] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:45.565094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.565476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.565684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.593466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:45.596218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69e69-beae-4375-807d-059a580879d6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:45.597510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:45.652582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88d353-62bc-41c6-b927-1b136d4be0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:45.653192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d353-62bc-41c6-b927-1b136d4be0af None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.653481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d353-62bc-41c6-b927-1b136d4be0af None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.653748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d353-62bc-41c6-b927-1b136d4be0af None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.654513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d353-62bc-41c6-b927-1b136d4be0af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:45.656102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d353-62bc-41c6-b927-1b136d4be0af None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:45.676569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Mar 29 15:43:45 2022] POST /identity/v3/roles => generated 225 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:43:45.678003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.678328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.678613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.698877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:45.699632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:45.700583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:45.735907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:45.796058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 22/43] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:45.821352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:45.864281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22490-19fd-4428-bd5b-14a56e5c7cf2 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:45.901074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:45.901921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.902257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.902542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.905696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:45.905836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:45.907634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:45.914063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:45.941054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78cff-5443-47b5-9018-5395bd22c1c2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:45.980509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb377e6-068b-4a4e-8702-cc0b2ae4c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:45.981538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb377e6-068b-4a4e-8702-cc0b2ae4c01d None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:45.982026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb377e6-068b-4a4e-8702-cc0b2ae4c01d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:45.982477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb377e6-068b-4a4e-8702-cc0b2ae4c01d None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:45.983368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb377e6-068b-4a4e-8702-cc0b2ae4c01d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:45.984925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb377e6-068b-4a4e-8702-cc0b2ae4c01d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:45.997943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Mar 29 15:43:45 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:43:46.016954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5da62e-f8bb-4f7e-86e9-64e379507108 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:46.052847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431130-be2c-4965-ab9f-5ce9c956a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:46.053532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431130-be2c-4965-ab9f-5ce9c956a29c None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:46.053874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431130-be2c-4965-ab9f-5ce9c956a29c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:46.054159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431130-be2c-4965-ab9f-5ce9c956a29c None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:46.054894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431130-be2c-4965-ab9f-5ce9c956a29c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:46.056438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431130-be2c-4965-ab9f-5ce9c956a29c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:46.091567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:43:45 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:43:47.898876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe0a8-719b-4eea-a300-c079c7446b4a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:47.899412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe0a8-719b-4eea-a300-c079c7446b4a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:47.899515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe0a8-719b-4eea-a300-c079c7446b4a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:47.901795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:47.907342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:47.907834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:47.908055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:47.925058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:47.926244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:47.988890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:48.012161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe0a8-719b-4eea-a300-c079c7446b4a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.112812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe0a8-719b-4eea-a300-c079c7446b4a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.143333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.144155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.144448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.144734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.156460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:48.163306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:43:48.164520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:43:48.170809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.263504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c9bdd-8120-48d8-9667-f7087d3a15ee None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.296070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.296743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.297032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.297313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.298064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:48.298371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:48.299789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c6da3-5453-4069-9a11-d2ad6a6cf72f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:48.312943 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:48.321191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.410904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c04b6-2bf9-4fba-8dfd-6dfa7fb86e59 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.411231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c04b6-2bf9-4fba-8dfd-6dfa7fb86e59 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.411646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c04b6-2bf9-4fba-8dfd-6dfa7fb86e59 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.413511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 26/51] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:43:48.418860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.419149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.419430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.424978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678971b-a128-45c1-a031-e963ece9a31c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.435884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:48.437060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:48.456445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.457314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.457597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.457880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.459052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:48.460535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:48.462122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 26/52] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:48 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:48.467758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.504070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 27/53] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:43:48.527742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.559816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387a1d3-64f6-4669-8cad-dc21d47e8f7f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.591498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.592302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.592591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.592872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.594038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:48.595495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:48.597114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:48.602749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.618607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4234158-cfe1-492f-8d10-1b922fc84474 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.649259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059da219-8f90-4558-8008-99df35086b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.650039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059da219-8f90-4558-8008-99df35086b80 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.650322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059da219-8f90-4558-8008-99df35086b80 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.650598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059da219-8f90-4558-8008-99df35086b80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.652286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059da219-8f90-4558-8008-99df35086b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:48.654008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059da219-8f90-4558-8008-99df35086b80 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:48.655778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:48.661046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059da219-8f90-4558-8008-99df35086b80 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:48.700211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025cde1-dd02-48a6-9b38-f2e176aa26b6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.731440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.732123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.732416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.732700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.733532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.domain.id=default, user.id=dd0ca27a61b54e5fb3070d05e2a206c1) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:48.733840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:48.735306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c3156-7cf5-4fa3-a487-03cc3a7b9b42 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:48.744270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Mar 29 15:43:48 2022] GET /identity/v3/role_assignments?user.id=dd0ca27a61b54e5fb3070d05e2a206c1&scope.domain.id=default&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:48.756471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059da219-8f90-4558-8008-99df35086b80 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:48.791544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c449cd-e577-42f2-89e5-d7e17449bb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:48.792251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c449cd-e577-42f2-89e5-d7e17449bb39 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:48.792536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c449cd-e577-42f2-89e5-d7e17449bb39 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:48.792811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c449cd-e577-42f2-89e5-d7e17449bb39 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:48.793527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c449cd-e577-42f2-89e5-d7e17449bb39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:48.794986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c449cd-e577-42f2-89e5-d7e17449bb39 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:48.824497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Mar 29 15:43:48 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:43:51.135828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555ec7-2f5f-4e42-8666-b875a33625ab None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:51.136315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555ec7-2f5f-4e42-8666-b875a33625ab None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:51.136315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555ec7-2f5f-4e42-8666-b875a33625ab None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:51.138086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:51.143105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:51.143505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:51.143698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:51.160441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:51.161598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:51.222933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:51.247001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555ec7-2f5f-4e42-8666-b875a33625ab None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:51.341573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555ec7-2f5f-4e42-8666-b875a33625ab None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:51.372804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28244e14-8dc6-437e-aaa5-cb071a303575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:51.373575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244e14-8dc6-437e-aaa5-cb071a303575 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:51.373861 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244e14-8dc6-437e-aaa5-cb071a303575 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:51.374141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244e14-8dc6-437e-aaa5-cb071a303575 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:51.375294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28244e14-8dc6-437e-aaa5-cb071a303575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:51.376760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28244e14-8dc6-437e-aaa5-cb071a303575 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:51.378297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:43:51.383517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:51.476768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de8a49-e515-4cb0-9b9c-5721b2649d2c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:51.508183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b89f84-1cd2-4ad3-8da7-5cbae8889ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:51.508863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b89f84-1cd2-4ad3-8da7-5cbae8889ee9 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:51.509148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b89f84-1cd2-4ad3-8da7-5cbae8889ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:51.509427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b89f84-1cd2-4ad3-8da7-5cbae8889ee9 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:51.510132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b89f84-1cd2-4ad3-8da7-5cbae8889ee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:51.511643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b89f84-1cd2-4ad3-8da7-5cbae8889ee9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:51.535692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:43:51 2022] POST /identity/v3/users => generated 275 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:43:54.945725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda7c1-2ad4-4a01-b0a2-78d27b3eab19 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:54.946716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda7c1-2ad4-4a01-b0a2-78d27b3eab19 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:54.947198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdda7c1-2ad4-4a01-b0a2-78d27b3eab19 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:54.949772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:54.955408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:54.956313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:54.956784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:54.980520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:54.982048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:55.066938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79390-fe48-4a3d-8882-668c2299a116 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.067489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79390-fe48-4a3d-8882-668c2299a116 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.068003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae79390-fe48-4a3d-8882-668c2299a116 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.070335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:55.071792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 32/64] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:55.075497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.076117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.076612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.098281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.108518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:55.109723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:55.241905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:55.265896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.268588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61139ecf-27d6-4c94-81b0-ebc7a57f7816 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.312056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0c809-cc82-4bc5-852c-dbca75574bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.312864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c809-cc82-4bc5-852c-dbca75574bf2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.313152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c809-cc82-4bc5-852c-dbca75574bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.313429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0c809-cc82-4bc5-852c-dbca75574bf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.331896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0c809-cc82-4bc5-852c-dbca75574bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:55.338881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-8ca0c809-cc82-4bc5-852c-dbca75574bf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:43:55.340528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:43:55.341588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa31c-c7ad-4c7e-a322-197c5d89b028 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.341877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa31c-c7ad-4c7e-a322-197c5d89b028 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.342155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4aa31c-c7ad-4c7e-a322-197c5d89b028 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.344073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 34/67] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:55.349287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aa31c-c7ad-4c7e-a322-197c5d89b028 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.414015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e581-caaf-4ddf-a88f-bf5609bdc147 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.448884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476df885-01a2-4924-b1f9-7a650ae6b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.449903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df885-01a2-4924-b1f9-7a650ae6b82b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.450413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df885-01a2-4924-b1f9-7a650ae6b82b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.450833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476df885-01a2-4924-b1f9-7a650ae6b82b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.461476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476df885-01a2-4924-b1f9-7a650ae6b82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:55.469084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-476df885-01a2-4924-b1f9-7a650ae6b82b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:43:55.470438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:43:55.475014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4aa31c-c7ad-4c7e-a322-197c5d89b028 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.476570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.477037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.477487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.495201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:55.496652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:55.512478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.513161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.513606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.513897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.514956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:55.515280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:55.516877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:55.529064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:55.530213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.579384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:55.581080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.641523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37d75-6445-4dc5-865e-60e7e7a3b025 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.672013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.672678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.672968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.673246 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.673990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:55.674298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:55.675727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc641-621c-454d-883a-39613f35a47d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:55.680899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ac3f-2319-4c70-a5e7-80559f202d9b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.683883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:55.685075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb36b-8e17-4df5-b4a4-5e285d2d3796 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.685367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb36b-8e17-4df5-b4a4-5e285d2d3796 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.685646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccb36b-8e17-4df5-b4a4-5e285d2d3796 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.687272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 37/72] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:55.688001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb36b-8e17-4df5-b4a4-5e285d2d3796 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.718700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ce480-fbac-4d60-b2a0-e3ab1ca8156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.719592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce480-fbac-4d60-b2a0-e3ab1ca8156d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.719880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce480-fbac-4d60-b2a0-e3ab1ca8156d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.720157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ce480-fbac-4d60-b2a0-e3ab1ca8156d None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.734624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ce480-fbac-4d60-b2a0-e3ab1ca8156d None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:55.736111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ce480-fbac-4d60-b2a0-e3ab1ca8156d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:55.737768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:55.742414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae4a1-d39d-4b7d-9229-1a59f8855871 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.742414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae4a1-d39d-4b7d-9229-1a59f8855871 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.742414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae4a1-d39d-4b7d-9229-1a59f8855871 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.742414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 37/74] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:55.742414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae4a1-d39d-4b7d-9229-1a59f8855871 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.787037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccb36b-8e17-4df5-b4a4-5e285d2d3796 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.819619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4327182-1c2b-4acb-8290-0de1d6e4d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.820431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327182-1c2b-4acb-8290-0de1d6e4d8ee None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.820716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327182-1c2b-4acb-8290-0de1d6e4d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.820999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327182-1c2b-4acb-8290-0de1d6e4d8ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.831640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327182-1c2b-4acb-8290-0de1d6e4d8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:55.839856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-c4327182-1c2b-4acb-8290-0de1d6e4d8ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:43:55.841294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:43:55.842448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a238ca0-5984-443b-9603-600e4b440e1a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.842735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a238ca0-5984-443b-9603-600e4b440e1a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.843025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a238ca0-5984-443b-9603-600e4b440e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.854145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae4a1-d39d-4b7d-9229-1a59f8855871 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:55.858343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8a238ca0-5984-443b-9603-600e4b440e1a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:55.859548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8a238ca0-5984-443b-9603-600e4b440e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:55.886155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:55.887024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.887315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.887623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.888810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:55.890281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:55.891964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:55.892763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:55.926490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 39/77] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:55.930714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e415c0-0909-4364-a71f-102cee6787af None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:55.931014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e415c0-0909-4364-a71f-102cee6787af None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:55.931301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e415c0-0909-4364-a71f-102cee6787af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:55.947148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-69e415c0-0909-4364-a71f-102cee6787af None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:55.948843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-69e415c0-0909-4364-a71f-102cee6787af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:55.985712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46585078-92dc-483e-8d2d-b69e183d23cf None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.011227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:56.011889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e415c0-0909-4364-a71f-102cee6787af None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.035585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.036242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.036530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.036809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.100884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.102487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.103601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e415c0-0909-4364-a71f-102cee6787af None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.134832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.135520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.136104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.136384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.137129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:56.137438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.138827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.146292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 41/79] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:56.147016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.194881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 39/80] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:43:56.195583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.242854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31458c71-f491-4b40-aafc-291463e15cbc None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.274193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.274829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.275119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.275402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.286554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b26a6-3325-41f3-96f8-e43af1f679c5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.318094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.318879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.319167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.319448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.320628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.322065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.323699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:56.324458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.339113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.340876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.417186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ae4e-8a22-4b01-9690-a2bf76ed1824 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.430619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 42/82] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:43:56.431438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.448497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.449286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.449573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.449850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.459616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:43:56.467273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:43:56.468476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 41/83] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:43:56.468476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.530629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010e58d-7049-445e-a057-c3375a5a5afd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.563500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0f4f-f96c-4ee2-af11-b0b45b2bfc8f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.566069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.566936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.567222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.567498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.568713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.570182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.572011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:56.573104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.596861 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.597748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.598035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.598314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.599491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.600987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.602655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 42/85] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:56.603428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.668225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb7c58-4ce5-4241-800c-17d536acb443 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.694997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9442a0-6eb1-4372-9d06-c5e36465aee2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.699729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.700397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.700686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.700964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.701678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.703119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.722401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 44/86] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:43:56 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:43:56.723199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.727597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.728494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.728817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.729096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.730387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.731933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.733729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 43/87] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:56.736537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.836013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e4e28-27bc-4d5a-b374-78995032ee3e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.842889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a713-5210-4763-880f-9cc58f0dd16b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:56.871596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.872285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.872571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.872851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.873622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:56.873961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.875374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.878844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:56.879772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:56.880228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:56.880691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:56.884206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 45/88] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:56.885299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:56.960870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:56.962804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:56.986971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b23cb5-c9e2-4227-8da9-f630fa48d577 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.022416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.023156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.023374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.023691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.024540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=25fc5870b2554018a0da2cb26e1365b3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:57.024907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.026865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.032844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 46/89] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/role_assignments?user.id=25fc5870b2554018a0da2cb26e1365b3&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=393e0469706749d1a4f1b2494247edea => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:57.033496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:57.071734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 44/90] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:43:57.072809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:57.143033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415afe41-0c3f-47e1-9380-1fd3c4013659 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.178899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.179605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.179899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.180077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8601b-89a3-4542-a2a1-ed0c45e26640 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.180173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.181023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=dd0ca27a61b54e5fb3070d05e2a206c1) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:57.181341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.183389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.189296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 47/91] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/role_assignments?user.id=dd0ca27a61b54e5fb3070d05e2a206c1&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:57.190162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:57.284310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.285222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.285515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.285797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.287158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.288689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.290431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 45/92] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:57.310866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:57.317465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6206bb-79f2-4720-b5b4-cae68aa872dd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.361443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.362331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.362621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.362905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.364313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.365814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.369084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 48/93] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:57.376228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:57.489786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452cf51-c4e1-46d8-9c66-d77bdf0e0585 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.497487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91eec4-8f96-48a9-ab76-c2c350578a2b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.537735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.538335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.538626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.538910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.539784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] RBAC: Adding query filter params (role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=25fc5870b2554018a0da2cb26e1365b3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:57.540106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.542120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.552886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.553555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 49/94] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/role_assignments?user.id=25fc5870b2554018a0da2cb26e1365b3&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:57.554039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.554543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.555048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.636240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.638109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.772325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 46/95] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:43:57.778729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:57.908975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0649d-4678-44b7-823c-d78d05e90793 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:57.952228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf78c8-dbab-45c0-8183-b66d9c0813d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:57.953107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf78c8-dbab-45c0-8183-b66d9c0813d0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:57.953679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf78c8-dbab-45c0-8183-b66d9c0813d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:57.953963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf78c8-dbab-45c0-8183-b66d9c0813d0 None admin] PATH_INFO: `/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:57.955177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf78c8-dbab-45c0-8183-b66d9c0813d0 None admin] RBAC: Authorizing `identity:get_project(project_id=f03c6683f045491eb8cb9c1dc4425d2a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:57.956680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf78c8-dbab-45c0-8183-b66d9c0813d0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:57.958362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 50/96] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:57.964785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:43:58.102394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1717c1-95e8-4828-98ab-2aee9c4fc0ba None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:43:58.145481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:43:58.146154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:58.146448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:58.146734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:58.147591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=f03c6683f045491eb8cb9c1dc4425d2a, user.id=25fc5870b2554018a0da2cb26e1365b3) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:43:58.147916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:43:58.149372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44746b-7103-4b9d-8421-7de04e4a238f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:43:58.159441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 47/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:43:57 2022] GET /identity/v3/role_assignments?user.id=25fc5870b2554018a0da2cb26e1365b3&scope.project.id=f03c6683f045491eb8cb9c1dc4425d2a&role.id=393e0469706749d1a4f1b2494247edea => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:43:59.779371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea5ca-c84b-404d-9314-94cfc2e68c10 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:59.779945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea5ca-c84b-404d-9314-94cfc2e68c10 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:59.779945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ea5ca-c84b-404d-9314-94cfc2e68c10 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:59.781879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 51/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:43:59.787188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:43:59.787637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:43:59.787807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:43:59.816562 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:43:59.817759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:43:59.890716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 48/99] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:43:59.913350 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea5ca-c84b-404d-9314-94cfc2e68c10 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.023056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ea5ca-c84b-404d-9314-94cfc2e68c10 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:00.055958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623aca6-3dc9-4f0f-b781-c64c62177b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:00.057259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623aca6-3dc9-4f0f-b781-c64c62177b54 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.057546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623aca6-3dc9-4f0f-b781-c64c62177b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.057829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623aca6-3dc9-4f0f-b781-c64c62177b54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.068499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623aca6-3dc9-4f0f-b781-c64c62177b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:00.076568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b623aca6-3dc9-4f0f-b781-c64c62177b54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:00.078047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 52/100] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:43:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:00.083907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.183717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981a83-985a-4a7d-9811-f9abad0499d5 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:00.217580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:00.218259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.218547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.218827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.219607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:00.219910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:00.221290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:00.227281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc91eca-20f0-4060-bdad-e8a75f880cdf None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.227595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc91eca-20f0-4060-bdad-e8a75f880cdf None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.227883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc91eca-20f0-4060-bdad-e8a75f880cdf None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.230345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 53/101] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:00.235518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.235834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.236114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.244982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 49/102] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:00.252997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.272308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:00.273591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:00.389696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e821d5-809c-496b-b9dd-b0e92a6a4609 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:00.397000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 54/103] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:00.422953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:00.423875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.424168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.424449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] PATH_INFO: `/v3/users/f114fe8cb9a5438d8eff1a502fec6407` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.437995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] RBAC: Authorizing `identity:get_user(user_id=f114fe8cb9a5438d8eff1a502fec6407)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:00.438723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.439475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:00.441361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 50/104] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/users/f114fe8cb9a5438d8eff1a502fec6407 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:00.452730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.580150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3dbda-8840-4206-999a-273c940ccf0a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:00.620974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d759-fb7a-4abc-85bb-b5ddd286d8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:00.621644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d759-fb7a-4abc-85bb-b5ddd286d8d2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.621934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d759-fb7a-4abc-85bb-b5ddd286d8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.622216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d759-fb7a-4abc-85bb-b5ddd286d8d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.695371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d759-fb7a-4abc-85bb-b5ddd286d8d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:00.696884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d759-fb7a-4abc-85bb-b5ddd286d8d2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:00.702276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d097e9-5cbe-4637-ac16-8f3a166e560c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:00.792755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8af6ec-2ef8-44a5-a117-1a2b8affe8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:00.793567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af6ec-2ef8-44a5-a117-1a2b8affe8bb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.793849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af6ec-2ef8-44a5-a117-1a2b8affe8bb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.794125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8af6ec-2ef8-44a5-a117-1a2b8affe8bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.802071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 51/105] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:00.803413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093072e6-c665-41d3-b4c4-7c5404e5b148 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.803734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093072e6-c665-41d3-b4c4-7c5404e5b148 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.804019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093072e6-c665-41d3-b4c4-7c5404e5b148 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.805144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8af6ec-2ef8-44a5-a117-1a2b8affe8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:00.805691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 52/106] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:00.807312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9267cd-d773-4009-83cc-e680052dbefa None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.807638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9267cd-d773-4009-83cc-e680052dbefa None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.807920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9267cd-d773-4009-83cc-e680052dbefa None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.809742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 53/107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:00.810469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9267cd-d773-4009-83cc-e680052dbefa None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.813486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2a8af6ec-2ef8-44a5-a117-1a2b8affe8bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:00.814928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 55/108] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:00.820520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9b4d-5e1f-4f79-8317-39ff99cd3e38 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.820812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9b4d-5e1f-4f79-8317-39ff99cd3e38 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.821095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9b4d-5e1f-4f79-8317-39ff99cd3e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.838182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0b1a9b4d-5e1f-4f79-8317-39ff99cd3e38 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:00.839295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0b1a9b4d-5e1f-4f79-8317-39ff99cd3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:00.909607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 56/109] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:00.911017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.911313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.911622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.916236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9267cd-d773-4009-83cc-e680052dbefa None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:00.928176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:00.929356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:00.951086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:00.952035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:00.952320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:00.952605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:00.953784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:00.955294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:00.957117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 54/110] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:00.957946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:00.999413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 57/111] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:01.000339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.061329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ef089-e8e2-4615-a194-1050950b49c9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.096217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.096812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.097099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.097377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.098127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] RBAC: Adding query filter params (name=member) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:01.098436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.099372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63dfac-911d-439e-8d95-2ed4a968557b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.099857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.108715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 55/112] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.114020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.133926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.134768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.135055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.135339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.145687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:01.152817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:01.154094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 58/113] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:01.154707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.213853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22368906-0f80-47bf-8aa6-781ba2272314 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.248274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.248931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.249219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.249499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.250331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] RBAC: Adding query filter params (role.id=ebd6282f133340818c7bee6ee7efb357, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=f114fe8cb9a5438d8eff1a502fec6407) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:01.250644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.252173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.253278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b5ac6-0c8c-4a67-8180-ecee22dc1357 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.257795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 56/114] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/role_assignments?user.id=f114fe8cb9a5438d8eff1a502fec6407&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=ebd6282f133340818c7bee6ee7efb357 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.258688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.292364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.293182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.293472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.293754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.294995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.296540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.298202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.298987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.405295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55d14-1ba2-443b-a843-fe12fb957a9c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.411156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914cac2-bff4-4cbe-a5bd-87c09890763b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.441595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.442294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.442584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.442868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.443678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:01.443995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.445430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.458160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 60/116] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.459059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.461972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db0579-13e5-47d9-be54-1edffebb2dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.464050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db0579-13e5-47d9-be54-1edffebb2dec None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.464669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db0579-13e5-47d9-be54-1edffebb2dec None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.465423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db0579-13e5-47d9-be54-1edffebb2dec None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.467062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db0579-13e5-47d9-be54-1edffebb2dec None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.469034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db0579-13e5-47d9-be54-1edffebb2dec None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.471381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 57/117] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.472966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ed63-9ba2-4d44-8215-39a1fbb70014 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.473512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ed63-9ba2-4d44-8215-39a1fbb70014 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.474007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ed63-9ba2-4d44-8215-39a1fbb70014 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.480605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 58/118] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:01.481905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ed63-9ba2-4d44-8215-39a1fbb70014 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.573041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebe8b3-7e5d-4749-b4da-d95af8dce08e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.609335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.610388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.610924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.611574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.612568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.614229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.616017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ed63-9ba2-4d44-8215-39a1fbb70014 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.655634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 61/119] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:44:01 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:01.655807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff9ca8-21e2-48b5-8fe7-fc73ebbbf26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.655807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9ca8-21e2-48b5-8fe7-fc73ebbbf26f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.655807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9ca8-21e2-48b5-8fe7-fc73ebbbf26f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.655807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff9ca8-21e2-48b5-8fe7-fc73ebbbf26f None admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.656076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.660449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9ca8-21e2-48b5-8fe7-fc73ebbbf26f None admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.665612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff9ca8-21e2-48b5-8fe7-fc73ebbbf26f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.667885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 59/120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.672390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.672715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.672987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.711749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:01.713104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:01.780332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bbe7c-1f5d-426c-a90e-108d3c4c2c10 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.802310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 60/121] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:01.803284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.819343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b19107-4120-474b-8fd3-b6085bf47550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.820262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19107-4120-474b-8fd3-b6085bf47550 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.820550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19107-4120-474b-8fd3-b6085bf47550 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.820832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b19107-4120-474b-8fd3-b6085bf47550 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.822628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b19107-4120-474b-8fd3-b6085bf47550 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.824159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b19107-4120-474b-8fd3-b6085bf47550 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.826029 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 62/122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.827088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c6c2-3a19-43bf-9be3-2b705411e34b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.827376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c6c2-3a19-43bf-9be3-2b705411e34b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.827682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593c6c2-3a19-43bf-9be3-2b705411e34b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.829437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 63/123] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:01.831495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c6c2-3a19-43bf-9be3-2b705411e34b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:01.918072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19e38-324a-438d-b1f2-a0ef6c06f158 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.948326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593c6c2-3a19-43bf-9be3-2b705411e34b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:01.955249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210fa10-864b-4d52-8768-5999dfc9eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.956172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fa10-864b-4d52-8768-5999dfc9eb1f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.956459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fa10-864b-4d52-8768-5999dfc9eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.956732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fa10-864b-4d52-8768-5999dfc9eb1f None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.957939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210fa10-864b-4d52-8768-5999dfc9eb1f None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.959408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210fa10-864b-4d52-8768-5999dfc9eb1f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:01.961118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 61/124] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:01 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:01.962257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.962600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.963385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.983794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:01.984984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:01.991547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:01.992467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:01.992751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:01.993034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/25fc5870b2554018a0da2cb26e1365b3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:01.995309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e53c7c9eba9492b9601de8600ce6616, user_id=25fc5870b2554018a0da2cb26e1365b3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:01.996789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.012661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 64/125] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:01 2022] PUT /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/25fc5870b2554018a0da2cb26e1365b3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:02.014063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.059973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 62/126] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:02.061207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.136867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0321e2b-117f-4758-9840-b5a86205c9d9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.176236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.176980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.177269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.177552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.188743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:02.193071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558979-3b6b-494c-bfa2-e7526bec30e3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.196554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:02.198205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 65/127] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:02.199038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.231828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.233103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.233601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.234148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/dd0ca27a61b54e5fb3070d05e2a206c1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.237266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e53c7c9eba9492b9601de8600ce6616, user_id=dd0ca27a61b54e5fb3070d05e2a206c1, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.239122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.260508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 63/128] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:02 2022] PUT /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/dd0ca27a61b54e5fb3070d05e2a206c1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:02.268478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.307754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467cce3-4a93-4147-893f-13562cd70809 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.347074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.347556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.347859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.348196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.360395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:02.367603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:02.369409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 66/129] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:02.375089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.408240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce717dcb-a80f-44d0-91b1-8372a8211a10 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.444092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.445093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.445603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.446152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.447239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:02.447782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.449456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.458728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 64/130] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:02.465313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.482211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08813163-1770-4785-a651-30aaf1c08e48 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.517883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.518575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.518864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.519143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.519987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:02.520301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.521726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.531404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 67/131] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:02.537206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.640592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f6f52-1bcd-4be1-b0cc-ff51fa317ea4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.641253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46602-e7d6-40a3-aad8-160f00be8290 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.674728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.675753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.676041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.676324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.677219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.677645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.678103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.678391 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.678721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.679116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.680031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.681050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 68/132] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:02.681553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.686343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.688133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 65/133] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:02.689050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.785903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb784-78d1-4bfb-8361-53dc71a76bbd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.820043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.820910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.821199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.821477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] PATH_INFO: `/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.824309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=f03c6683f045491eb8cb9c1dc4425d2a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.825782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.827703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 69/134] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:02.833065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:02.902211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5287a1-9a4b-4723-a0d2-26c8b198bbf1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.933863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9724f-55d5-4912-b2d3-f02f13b1eaf8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:02.967952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.968854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.969146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.969431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] PATH_INFO: `/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a/users/25fc5870b2554018a0da2cb26e1365b3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:02.971413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f03c6683f045491eb8cb9c1dc4425d2a, user_id=25fc5870b2554018a0da2cb26e1365b3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:02.972920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:02.986634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 70/135] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:02 2022] PUT /identity/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a/users/25fc5870b2554018a0da2cb26e1365b3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:44:02.997513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f71f2-5364-47d8-9708-7137ad8c3e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:02.998555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f71f2-5364-47d8-9708-7137ad8c3e48 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:02.998847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f71f2-5364-47d8-9708-7137ad8c3e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:02.999128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f71f2-5364-47d8-9708-7137ad8c3e48 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:03.004606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f71f2-5364-47d8-9708-7137ad8c3e48 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:03.006164 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f71f2-5364-47d8-9708-7137ad8c3e48 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:03.008086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:02 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:03.014084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:03.139744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c7ceb-7726-4b9b-8301-5c22d4fd89a4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:03.174734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc7c17-f6ae-4c28-a048-3fa098684710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:03.175682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc7c17-f6ae-4c28-a048-3fa098684710 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:03.175974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc7c17-f6ae-4c28-a048-3fa098684710 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:03.176257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc7c17-f6ae-4c28-a048-3fa098684710 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/25fc5870b2554018a0da2cb26e1365b3/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:03.178548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc7c17-f6ae-4c28-a048-3fa098684710 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e53c7c9eba9492b9601de8600ce6616, user_id=25fc5870b2554018a0da2cb26e1365b3, role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:03.180054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc7c17-f6ae-4c28-a048-3fa098684710 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:03.193619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 71/137] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:03 2022] PUT /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/25fc5870b2554018a0da2cb26e1365b3/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:04.400780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03d2c2-880f-4eda-a8fe-f5f14bbc703a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:04.401283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03d2c2-880f-4eda-a8fe-f5f14bbc703a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:04.401356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03d2c2-880f-4eda-a8fe-f5f14bbc703a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:04.403454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 67/138] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:04.408919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb80aa7-e870-4235-8310-0be839a0d707 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:04.409347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb80aa7-e870-4235-8310-0be839a0d707 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:04.409517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb80aa7-e870-4235-8310-0be839a0d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:04.426085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2bb80aa7-e870-4235-8310-0be839a0d707 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:04.427245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2bb80aa7-e870-4235-8310-0be839a0d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:04.492948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:04.507332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3fdb8-bbdc-42a7-a4a3-09a782db9be3 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:04.507643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3fdb8-bbdc-42a7-a4a3-09a782db9be3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:04.507950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3fdb8-bbdc-42a7-a4a3-09a782db9be3 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:04.510260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 68/140] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:04.515496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:04.515819 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:04.516102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:04.523182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3fdb8-bbdc-42a7-a4a3-09a782db9be3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:04.543553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:04.543553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:04.668293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 73/141] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:04.676671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3fdb8-bbdc-42a7-a4a3-09a782db9be3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:04.704145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:04.752152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:04.752957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:04.753244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:04.753524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:04.758090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:04.760090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:04.761961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 69/142] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:04.771484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:04.864920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188008-3c53-4cd9-903b-d356bf4400cf None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:04.898605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:04.899404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:04.899750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:04.900092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:04.910304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:04.918230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:04.919799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 74/143] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:04.925340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:04.975250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3e72c-43a5-46a9-9c57-c5f936daf84d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:05.027633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7da79-5af1-4566-b3ac-730ff14fceaf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:05.052239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc839-4023-4835-984b-d6127073b672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:05.053290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc839-4023-4835-984b-d6127073b672 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.053807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc839-4023-4835-984b-d6127073b672 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.054293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc839-4023-4835-984b-d6127073b672 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.055215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc839-4023-4835-984b-d6127073b672 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:05.056948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc839-4023-4835-984b-d6127073b672 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:05.061619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:05.062394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.062682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.062961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.063747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:05.064055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:05.065442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:05.074359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 75/144] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:05.080080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:05.098708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 70/145] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:04 2022] POST /identity/v3/users => generated 283 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:05.186264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f79e6-c5a2-47d2-be59-99885d2c968c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:05.219947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:05.220854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.221132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.221404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] PATH_INFO: `/v3/users/f114fe8cb9a5438d8eff1a502fec6407` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.222709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] RBAC: Authorizing `identity:get_user(user_id=f114fe8cb9a5438d8eff1a502fec6407)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:05.224237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:05.226089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 76/146] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:05 2022] GET /identity/v3/users/f114fe8cb9a5438d8eff1a502fec6407 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:05.232453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc839-4023-4835-984b-d6127073b672 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:05.362476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc839-4023-4835-984b-d6127073b672 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:05.405631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758329-653b-49e4-81af-40c5b98a62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:05.406502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758329-653b-49e4-81af-40c5b98a62ae None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.406787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758329-653b-49e4-81af-40c5b98a62ae None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.407067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758329-653b-49e4-81af-40c5b98a62ae None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.408286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758329-653b-49e4-81af-40c5b98a62ae None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:05.409760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758329-653b-49e4-81af-40c5b98a62ae None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:05.411449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 71/147] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:05 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:05.417315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:05.517260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e1adb-efcc-41c3-9763-85b097a55b16 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:05.554177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf944-d79d-45ff-b1be-cf2eae020753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:05.555082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf944-d79d-45ff-b1be-cf2eae020753 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.555361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf944-d79d-45ff-b1be-cf2eae020753 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.555671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf944-d79d-45ff-b1be-cf2eae020753 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/f114fe8cb9a5438d8eff1a502fec6407/roles/ebd6282f133340818c7bee6ee7efb357` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.557731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebf944-d79d-45ff-b1be-cf2eae020753 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e53c7c9eba9492b9601de8600ce6616, user_id=f114fe8cb9a5438d8eff1a502fec6407, role_id=ebd6282f133340818c7bee6ee7efb357)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:05.559191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebf944-d79d-45ff-b1be-cf2eae020753 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:05.579684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 77/148] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:05 2022] PUT /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616/users/f114fe8cb9a5438d8eff1a502fec6407/roles/ebd6282f133340818c7bee6ee7efb357 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:05.940077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d25b3a-0e15-4446-ada8-37896695a636 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.940415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d25b3a-0e15-4446-ada8-37896695a636 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.940594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d25b3a-0e15-4446-ada8-37896695a636 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.942342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 72/149] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:05.948718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:05.949008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:05.949282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:05.966189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:05.971445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:06.055591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 78/150] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:06.095794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d25b3a-0e15-4446-ada8-37896695a636 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.206625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d25b3a-0e15-4446-ada8-37896695a636 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:06.241174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e03c21-eec0-49d7-aa71-391069b81ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:06.241978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03c21-eec0-49d7-aa71-391069b81ad7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.242266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03c21-eec0-49d7-aa71-391069b81ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.242544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e03c21-eec0-49d7-aa71-391069b81ad7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.253681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e03c21-eec0-49d7-aa71-391069b81ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:06.260752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-69e03c21-eec0-49d7-aa71-391069b81ad7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:06.261988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 73/151] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:06.267888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.312931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c569-f7db-4899-a2ed-9e4f3a877c33 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.313232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c569-f7db-4899-a2ed-9e4f3a877c33 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.313638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c569-f7db-4899-a2ed-9e4f3a877c33 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.315845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 74/152] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:06.337645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.337944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.338210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.369166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:06.370406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:06.394714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac0c9b-8556-4d4f-8a25-95da14b97f10 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:06.430886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:06.431741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.431930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.432213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.432985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:06.433287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:06.434703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:06.443726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:06.450085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.480270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 75/154] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:06.543686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.604530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c97067-f1f7-45b8-b292-80c090b9c3e9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:06.663932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7246528-6802-4e0e-8fd4-af2ed216b794 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:06.669538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:06.670488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.670807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.671099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.675006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:06.676583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:06.679174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 80/155] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:06.686841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.707242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:06.708083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.708370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.708647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.720047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:06.727010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:06.728329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 76/156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:06.734113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.802447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b3311-085c-4b59-8af3-e3a7a47c5faa None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:06.840153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:06.840810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.841090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.841364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.854964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb046f-25f8-4409-b688-a9131f111021 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:06.890102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:06.890813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:06.891071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:06.891360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:06.892144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:06.892455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:06.893863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:06.902698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 77/157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:06.908453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:06.909258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:06.910866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.010555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b248c-f415-4549-a3f5-b9393e192b0d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.012272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 81/158] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:07.021021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.072274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.073224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.073517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.073799 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] PATH_INFO: `/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.075074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] RBAC: Authorizing `identity:get_user(user_id=dd0ca27a61b54e5fb3070d05e2a206c1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:07.076606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.078242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 78/159] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:06 2022] GET /identity/v3/users/dd0ca27a61b54e5fb3070d05e2a206c1 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:07.083757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.126977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcf35-93cd-4eb3-bde3-9e9d8dc20bf5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.169867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4052d-8773-4873-a231-0c5e8a07fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.170730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4052d-8773-4873-a231-0c5e8a07fd6d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.171012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4052d-8773-4873-a231-0c5e8a07fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.171449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4052d-8773-4873-a231-0c5e8a07fd6d None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.173247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4052d-8773-4873-a231-0c5e8a07fd6d None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:07.175158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4052d-8773-4873-a231-0c5e8a07fd6d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.177660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 82/160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:07.179018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649fa7d-a341-41b5-9cb7-16058ef7867e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.179289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649fa7d-a341-41b5-9cb7-16058ef7867e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.179598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649fa7d-a341-41b5-9cb7-16058ef7867e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.181755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 83/161] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:07.184898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649fa7d-a341-41b5-9cb7-16058ef7867e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.206835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009b99-23e7-4397-9d4b-44f24a8d0223 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.241286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598b871-deff-4124-b03c-b78f7bd168af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.241943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b871-deff-4124-b03c-b78f7bd168af None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.242233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b871-deff-4124-b03c-b78f7bd168af None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.242514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598b871-deff-4124-b03c-b78f7bd168af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.288674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649fa7d-a341-41b5-9cb7-16058ef7867e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.311512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598b871-deff-4124-b03c-b78f7bd168af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:07.313191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598b871-deff-4124-b03c-b78f7bd168af None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.325067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.325729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.326010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.326288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.327119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=25fc5870b2554018a0da2cb26e1365b3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:07.327428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:07.328928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224a581-1161-49f6-aca3-15a8b71e93f9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.335133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 84/162] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/role_assignments?user.id=25fc5870b2554018a0da2cb26e1365b3&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=393e0469706749d1a4f1b2494247edea => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:07.336570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.336858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.337129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.355615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:07.356823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:07.423627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 79/163] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:07.425053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665c06-3f7d-4393-85fd-b4cd23de404f None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.425350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665c06-3f7d-4393-85fd-b4cd23de404f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.425635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665c06-3f7d-4393-85fd-b4cd23de404f None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.427307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 80/164] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:07.433274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04106dd0-1c04-4419-a009-163789da88ca None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.433568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04106dd0-1c04-4419-a009-163789da88ca None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.433858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04106dd0-1c04-4419-a009-163789da88ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.439747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 85/165] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:07.441392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.476593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-04106dd0-1c04-4419-a009-163789da88ca None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:07.477868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-04106dd0-1c04-4419-a009-163789da88ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:07.562504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c3ed-1e4a-449d-bc71-c278a30080d7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.598858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.600108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.600551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.600964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.602301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:07.604002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.605885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 86/166] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:07.606956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.661994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 81/167] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:07.662878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04106dd0-1c04-4419-a009-163789da88ca None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.710297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc931e-ce02-4e78-8a09-485f389933c4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.745974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.747089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.747509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.747945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.759752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:07.767782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:07.769545 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 87/168] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:07.770544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.871105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a6436-ec7b-49c8-bc14-d2118e85a1d7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.895163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04106dd0-1c04-4419-a009-163789da88ca None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:07.904960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.906012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.906429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.906889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.926895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:07.942328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:07.942328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 88/169] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:07.942328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:07.970693 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:07.971732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:07.972175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:07.973972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:07.974962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=dd0ca27a61b54e5fb3070d05e2a206c1) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:07.976191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:07.978361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:07.998403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 82/170] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/role_assignments?user.id=dd0ca27a61b54e5fb3070d05e2a206c1&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:07.999646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:08.152317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f9ce-a128-44e4-aec3-93f6885a3356 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:08.199728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d49b7-fc57-4a51-826c-fa9d5c980a16 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:08.225532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:08.226506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:08.227038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:08.228055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:08.229386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:08.230677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:08.233892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:08.250277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 89/171] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:08.257559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:08.285431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:08.286487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:08.286917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:08.287335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:08.288312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:08.291044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:08.293968 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:08.313736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 83/172] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:08.319293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:08.453131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e288f-7182-4aea-ae87-db84d87e9ae7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:08.493484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:08.495575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:08.498080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:08.498509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:08.500980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:08.502607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:08.505717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 84/173] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:08 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:08.511773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:08.527200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81543f-b998-4095-83bb-f9032bbbdcd8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:08.601082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:08.602220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:08.602660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:08.603145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] PATH_INFO: `/v3/users/25fc5870b2554018a0da2cb26e1365b3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:08.606261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] RBAC: Authorizing `identity:get_user(user_id=25fc5870b2554018a0da2cb26e1365b3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:08.607953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:08.613230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 90/174] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:08 2022] GET /identity/v3/users/25fc5870b2554018a0da2cb26e1365b3 => generated 275 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:08.618919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:08.707766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e04da-db9a-43e0-9ebd-602dd85f8d9e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:08.760070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14085900-f05b-448c-93fc-980a33b3d70c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:08.808929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:08.809598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:08.809878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:08.810148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:08.814314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:08.814982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:08.815269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:08.815593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:08.928318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:08.929807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:09.032372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:09.033873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:09.072922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 91/175] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:09.079222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:09.258333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 85/176] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:09.264884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:09.300439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f6ad9-a6ee-4cf9-9cfa-e81ca9ab708f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:09.400284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:09.401164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.401447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.401724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] PATH_INFO: `/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.408356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] RBAC: Authorizing `identity:get_project(project_id=f03c6683f045491eb8cb9c1dc4425d2a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:09.409859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:09.411781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 92/177] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:09 2022] GET /identity/v3/projects/f03c6683f045491eb8cb9c1dc4425d2a => generated 312 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:09.418527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:09.445273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10350d-895e-49e2-9df9-2cec002b6213 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:09.515350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:09.516305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.516594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.516866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.524290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:09.525835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:09.527821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 86/178] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:09 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:09.536612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:09.616569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3da3d-7ab7-4080-8e9a-216b5b62bd5c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:09.712806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:09.713537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.713828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.714196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.715303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=f03c6683f045491eb8cb9c1dc4425d2a, user.id=25fc5870b2554018a0da2cb26e1365b3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:09.715628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:09.717091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a9c73-4cee-4e09-b02d-c4bf1ab5b626 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:09.723322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 93/179] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:09 2022] GET /identity/v3/role_assignments?user.id=25fc5870b2554018a0da2cb26e1365b3&scope.project.id=f03c6683f045491eb8cb9c1dc4425d2a&role.id=393e0469706749d1a4f1b2494247edea => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:09.724818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c27d5-bd9a-4d6f-905c-6de7b5312627 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.725239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c27d5-bd9a-4d6f-905c-6de7b5312627 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.725674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c27d5-bd9a-4d6f-905c-6de7b5312627 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.727429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 94/180] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:09.733019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad656-e2a4-4c0c-b00f-0ded3d44f23b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.733499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad656-e2a4-4c0c-b00f-0ded3d44f23b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.733948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ad656-e2a4-4c0c-b00f-0ded3d44f23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.753183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-976ad656-e2a4-4c0c-b00f-0ded3d44f23b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:09.755267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-976ad656-e2a4-4c0c-b00f-0ded3d44f23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:09.838025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92947d-1377-4b00-8a13-7dd42c075f71 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:09.860025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 95/181] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:09.862290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd063364-2ebd-427c-8668-bf74e2755d13 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.862804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd063364-2ebd-427c-8668-bf74e2755d13 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.863297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd063364-2ebd-427c-8668-bf74e2755d13 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.866859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 96/182] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:09.876024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.876508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.876990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.933050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:09.935096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:09.954284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:09.955272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:09.955760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:09.956173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:09.957149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] RBAC: Adding query filter params (role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=25fc5870b2554018a0da2cb26e1365b3) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:09.957603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:09.959233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:09.975587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 87/183] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:09 2022] GET /identity/v3/role_assignments?user.id=25fc5870b2554018a0da2cb26e1365b3&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 608 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:09.977141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.134926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 97/184] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:10.166655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.192349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e10cb7-2373-476a-99a3-8d173429a070 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.235555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3576d0-2334-448d-886d-054407228876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.236694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3576d0-2334-448d-886d-054407228876 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.237198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3576d0-2334-448d-886d-054407228876 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.237688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3576d0-2334-448d-886d-054407228876 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.280499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3576d0-2334-448d-886d-054407228876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:10.298519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-ab3576d0-2334-448d-886d-054407228876 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:10.309913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 88/185] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:10.316419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3576d0-2334-448d-886d-054407228876 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.379975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9711-7bbe-4372-a48a-1bc797da1154 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.441384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.442119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.442400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.442672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.459784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:10.468663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:10.469902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 98/186] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:10.475832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.481090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3576d0-2334-448d-886d-054407228876 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.518291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.519021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.519309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.519663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.520421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] RBAC: Adding query filter params (name=reader) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:10.520732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:10.522226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f631d1a-a652-4590-b351-e0be1de58bba None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:10.532303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 89/187] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:10.533643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3f91-d0c6-4c63-a29c-3d240988f3be None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.533990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3f91-d0c6-4c63-a29c-3d240988f3be None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.534272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3f91-d0c6-4c63-a29c-3d240988f3be None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.535983 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 90/188] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:10.540515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a3f91-d0c6-4c63-a29c-3d240988f3be None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.585787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34f4b-9332-4a18-9617-3206b68de448 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.619075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.619856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.620059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.620342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.621102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:10.621415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:10.622820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305b53-5512-44c6-87bd-fb55e198fd5b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:10.631178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 99/189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:10.632413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.632691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.632971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.648251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a3f91-d0c6-4c63-a29c-3d240988f3be None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.649157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:10.650360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:10.688319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.689932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.690419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.690914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] PATH_INFO: `/v3/users/f114fe8cb9a5438d8eff1a502fec6407` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.693033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] RBAC: Authorizing `identity:get_user(user_id=f114fe8cb9a5438d8eff1a502fec6407)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:10.695134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:10.698183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 91/190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/users/f114fe8cb9a5438d8eff1a502fec6407 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:10.699613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.727552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 100/191] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:10.727552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.814289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aefcc-1a56-4ecd-8365-cbbf92b35430 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.821438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4159e6-468f-47a4-82c0-5a6b2f6f8954 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.845364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4425e-7875-41c9-8de8-bfeaa9a3663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.846010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4425e-7875-41c9-8de8-bfeaa9a3663c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.846293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4425e-7875-41c9-8de8-bfeaa9a3663c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.846563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4425e-7875-41c9-8de8-bfeaa9a3663c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.852373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.853749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.854032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.854324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] PATH_INFO: `/v3/users/80358f37ebb443ee93baabcb79f29485` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:10.866991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] RBAC: Authorizing `identity:get_user(user_id=80358f37ebb443ee93baabcb79f29485)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:10.869067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:10.870720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 92/192] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/users/80358f37ebb443ee93baabcb79f29485 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:10.871486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:10.910415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4425e-7875-41c9-8de8-bfeaa9a3663c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:10.911927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4425e-7875-41c9-8de8-bfeaa9a3663c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:10.962755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c023-56c9-4f88-9eae-2cc487d42d24 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:10.995039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe32c3-c46c-47ac-9bec-170d8f326cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:10.995862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe32c3-c46c-47ac-9bec-170d8f326cad None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:10.996157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe32c3-c46c-47ac-9bec-170d8f326cad None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:10.996435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe32c3-c46c-47ac-9bec-170d8f326cad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.003266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 101/193] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:11.004599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4740-6cbc-4d9d-8cf9-ba5ba597d191 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.004887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4740-6cbc-4d9d-8cf9-ba5ba597d191 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.005164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4740-6cbc-4d9d-8cf9-ba5ba597d191 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.006218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe32c3-c46c-47ac-9bec-170d8f326cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:11.006989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 102/194] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:11.007788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d4740-6cbc-4d9d-8cf9-ba5ba597d191 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.013689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-bdbe32c3-c46c-47ac-9bec-170d8f326cad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:11.019273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 93/195] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:11.019273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.019273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.019273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.032379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:11.033589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:11.096575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 94/196] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:11.107917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.107998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d4740-6cbc-4d9d-8cf9-ba5ba597d191 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.133493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.134710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.134993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.135265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.193488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7fa15-f27f-4fcb-9458-e10ba5d35be0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.200921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.202383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.225588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.226478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.226761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.227048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.228272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.229714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.231399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 95/197] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.232195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.300036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 103/198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:11.305369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.338624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82899ab7-fee2-43a6-8a5a-9a77f9ec6684 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.379852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.380530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.380817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.381510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.382272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:11.382582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.384444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.392329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 96/199] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.393131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.407391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f446c-dfdc-42bb-82bf-bf43198ac710 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.443769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.444568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.444853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.445131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.446324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.447822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.449585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 104/200] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.450186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.493170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3654e39-e5fc-4e90-b623-f24f152f4bb4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.526648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.527302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.527634 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.527915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.528740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] RBAC: Adding query filter params (role.id=ebd6282f133340818c7bee6ee7efb357, scope.project.id=6e53c7c9eba9492b9601de8600ce6616, user.id=f114fe8cb9a5438d8eff1a502fec6407) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:11.529053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.530716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.536801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 97/201] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/role_assignments?user.id=f114fe8cb9a5438d8eff1a502fec6407&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=ebd6282f133340818c7bee6ee7efb357 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.537873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.549000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8ec60-0863-424c-ad31-74d43583413a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.585101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.585971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.586247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.586518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.588356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.590093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.596700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 105/202] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.596700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.644975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed1f02-5e64-4e21-873a-03d5c18df231 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.678502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.679381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.679691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.679973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] PATH_INFO: `/v3/users/80358f37ebb443ee93baabcb79f29485` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.681226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] RBAC: Authorizing `identity:get_user(user_id=80358f37ebb443ee93baabcb79f29485)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.682687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.684527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 98/203] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/users/80358f37ebb443ee93baabcb79f29485 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.685144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.704611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f1292-c6ed-4bae-876a-5d30c875f6c5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.747358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.747358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.747754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.747964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.749258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.750135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.776724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 106/204] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:11 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:11.780380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:11.789582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f084f-3386-434d-9522-9aead4260f4d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.826811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.827479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.827804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.828073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:11.828920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=80358f37ebb443ee93baabcb79f29485) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:11.829234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:11.830717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:11.836949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 99/205] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/role_assignments?user.id=80358f37ebb443ee93baabcb79f29485&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:11.902707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73b967-0c56-4737-8492-fe1ea8af12da None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:11.940137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:11.940825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:11.941111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:11.941391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:12.016702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:12.018527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:12.120394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 107/206] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:12.126130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:12.227507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ecb06-f6af-4640-a2d4-a25b7bdb3b2d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:12.267630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029c257-61c4-49d0-b89f-93fe64c913f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:12.267630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029c257-61c4-49d0-b89f-93fe64c913f7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:12.267630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029c257-61c4-49d0-b89f-93fe64c913f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:12.267630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029c257-61c4-49d0-b89f-93fe64c913f7 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:12.267971 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029c257-61c4-49d0-b89f-93fe64c913f7 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:12.268050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029c257-61c4-49d0-b89f-93fe64c913f7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:12.269838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 100/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:12 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:12.276340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:12.373755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422612a-be83-4f2e-b01c-65f21e4777c2 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:12.407386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:12.408320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:12.408842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:12.409253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:12.410208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] RBAC: Adding query filter params (role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=80358f37ebb443ee93baabcb79f29485) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:12.410721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:12.412444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a4d1c-cf37-41a4-a881-df477b8dee9f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:12.418579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 108/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:12 2022] GET /identity/v3/role_assignments?user.id=80358f37ebb443ee93baabcb79f29485&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:14.146552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026324-51dd-49cb-ace3-5d0f6d3af35c None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.147056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026324-51dd-49cb-ace3-5d0f6d3af35c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.147056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026324-51dd-49cb-ace3-5d0f6d3af35c None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.149076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 101/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:14.155136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d02c2-8959-4e1b-906d-594d4cd7cf40 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.155573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d02c2-8959-4e1b-906d-594d4cd7cf40 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.155769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d02c2-8959-4e1b-906d-594d4cd7cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.173371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-fa9d02c2-8959-4e1b-906d-594d4cd7cf40 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:14.174549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fa9d02c2-8959-4e1b-906d-594d4cd7cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:14.241592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 109/210] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:14.264355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026324-51dd-49cb-ace3-5d0f6d3af35c None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.286650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a9d2a-9f9b-465f-9064-cff45116814c None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.286955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a9d2a-9f9b-465f-9064-cff45116814c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.287208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a9d2a-9f9b-465f-9064-cff45116814c None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.289331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 110/211] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:14.295994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03449-df5e-4a15-8332-4382f5c0eff0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.296284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03449-df5e-4a15-8332-4382f5c0eff0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.296565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a03449-df5e-4a15-8332-4382f5c0eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.317760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a8a03449-df5e-4a15-8332-4382f5c0eff0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:14.319105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a8a03449-df5e-4a15-8332-4382f5c0eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:14.380255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026324-51dd-49cb-ace3-5d0f6d3af35c None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.387320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 111/212] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:14.392157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee5f3-9422-4cf2-8040-71c964987c40 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.392665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee5f3-9422-4cf2-8040-71c964987c40 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.393158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee5f3-9422-4cf2-8040-71c964987c40 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.395079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 112/213] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:14.400879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61650aa-b142-411f-92c1-207957030fef None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.401433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61650aa-b142-411f-92c1-207957030fef None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.401901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61650aa-b142-411f-92c1-207957030fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.414397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.415268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.415586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.415838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.419788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b61650aa-b142-411f-92c1-207957030fef None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:14.420958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b61650aa-b142-411f-92c1-207957030fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:14.425801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:14.433234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:14.434569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 102/214] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:14.439751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.491747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 113/215] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:14.491747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61650aa-b142-411f-92c1-207957030fef None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.551378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9f68d-e97f-4ce7-b88d-fc8d752b5cd0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.588568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.589539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.589826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.590107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.598126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61650aa-b142-411f-92c1-207957030fef None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.599949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:14.607437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:14.608686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 103/216] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:14.609459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.639137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.639840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.640126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.640407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.641154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:14.641465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:14.642870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:14.655595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 114/217] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:14.656292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.708125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba7d15-3ce5-42fd-b912-06cc0a48af28 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.739891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.740679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.740967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.741242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.742408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:14.743951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:14.747877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 104/218] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:14.747877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.754815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068694-c8c9-47f0-afee-fc35639eb5e9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.786855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.787520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.787834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.788115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.788861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:14.789171 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:14.791043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4679f1d-c863-4fad-b795-3e8fcaaad295 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:14.798734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 115/219] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:14.803297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acf8b9-2a24-4b0c-b0a2-e8de22847213 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.803297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acf8b9-2a24-4b0c-b0a2-e8de22847213 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.803297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acf8b9-2a24-4b0c-b0a2-e8de22847213 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.803297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 116/220] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:14.803297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acf8b9-2a24-4b0c-b0a2-e8de22847213 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.842249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7203c-30ba-4b74-8ac1-a4ac8a6de325 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.873995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.874879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.875153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.875430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] PATH_INFO: `/v3/users/80358f37ebb443ee93baabcb79f29485` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.876710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=80358f37ebb443ee93baabcb79f29485)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:14.878171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:14.879853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 105/221] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/users/80358f37ebb443ee93baabcb79f29485 => generated 283 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:14.880598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:14.902619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acf8b9-2a24-4b0c-b0a2-e8de22847213 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:14.935770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57422958-c169-4d16-8e7a-a71535c1e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:14.936398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57422958-c169-4d16-8e7a-a71535c1e13a None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.936683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57422958-c169-4d16-8e7a-a71535c1e13a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.936957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57422958-c169-4d16-8e7a-a71535c1e13a None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.937659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57422958-c169-4d16-8e7a-a71535c1e13a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:14.939114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57422958-c169-4d16-8e7a-a71535c1e13a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:14.967610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 117/222] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:14 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:14.967610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:14.967610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:14.967610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:14.978624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:14.979861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:14.984989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79a9cb-1c6b-42f9-a383-56b535211dd4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.020364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.021262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.021546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.021813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] PATH_INFO: `/v3/users/e027e53e6b55417f897503d36c1714e8` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.036754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] RBAC: Authorizing `identity:get_user(user_id=e027e53e6b55417f897503d36c1714e8)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.038252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.040336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 106/223] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:14 2022] GET /identity/v3/users/e027e53e6b55417f897503d36c1714e8 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:15.040923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.056179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 118/224] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:15.057069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.152612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71798ff9-caf2-4d30-a74b-e5fe8baec002 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.159706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d3db3-a878-41cb-bd13-9d23fca04bf5 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.193824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.194774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.195162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.195588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.197441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.197646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.198969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.198969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.198969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.199193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.201185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 107/225] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:15.201673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.277095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.278671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.306336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97765999-a8f5-402a-a2b4-0d82d69fbbec None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.353246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.354409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.354915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.355389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.366107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:15.374038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:15.375483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 108/226] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:15.376533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.392640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 119/227] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:15.393649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.480054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7d3a-1179-4085-8485-925c7e85cc60 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.495783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbe000-f3e1-4965-ab1b-fa3de0555b16 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.514499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.515722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.516245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.516719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/80358f37ebb443ee93baabcb79f29485/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.518915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3318f50544fb0b70f6cb196f14333, user_id=80358f37ebb443ee93baabcb79f29485, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.520651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.533256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.533927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.534209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.534485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.535230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:15.535560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.536932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.541475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 109/228] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:15 2022] PUT /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/80358f37ebb443ee93baabcb79f29485/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:15.542300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.550026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 120/229] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:15.556968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.666823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8a9f2-021d-4425-b1bd-af0595c7f1ea None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.684515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48fed8-4ce7-4102-b94c-d9b313b29f1f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.717875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.719357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.719955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.720498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.721342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.722299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.722405 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.722675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.723036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] PATH_INFO: `/v3/users/80358f37ebb443ee93baabcb79f29485` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.724385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] RBAC: Authorizing `identity:get_user(user_id=80358f37ebb443ee93baabcb79f29485)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.724826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.725964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.726945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 110/230] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:15.731937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 121/231] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/users/80358f37ebb443ee93baabcb79f29485 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:15.733400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.733713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.839660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c92b62-62d5-40f4-9188-3a02c2212ecd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.857752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165948-7581-4ea8-a376-d56b8fd5c0d8 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:15.875033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.876021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.876479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.876729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.877934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.879405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.881439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 122/232] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:15.887046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:15.896828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:15.897812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:15.898299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:15.898801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:15.900384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=e027e53e6b55417f897503d36c1714e8) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:15.900898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:15.902536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86cec0-9356-4361-a9a7-f809e2010488 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:15.908523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 111/233] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:15 2022] GET /identity/v3/role_assignments?user.id=e027e53e6b55417f897503d36c1714e8&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=393e0469706749d1a4f1b2494247edea => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:15.997938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26515-3182-4347-98ee-c139bb90d573 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:16.033713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4fe6e-c071-4627-9ce6-f4934bbcb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:16.034633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4fe6e-c071-4627-9ce6-f4934bbcb4a5 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:16.034919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4fe6e-c071-4627-9ce6-f4934bbcb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:16.035197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4fe6e-c071-4627-9ce6-f4934bbcb4a5 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/80358f37ebb443ee93baabcb79f29485/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:16.037728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4fe6e-c071-4627-9ce6-f4934bbcb4a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3318f50544fb0b70f6cb196f14333, user_id=80358f37ebb443ee93baabcb79f29485, role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:16.039279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4fe6e-c071-4627-9ce6-f4934bbcb4a5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:16.059094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 123/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:15 2022] PUT /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/80358f37ebb443ee93baabcb79f29485/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:44:17.857275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aed985-9c52-4da7-b895-6537fec67c50 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:17.857771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aed985-9c52-4da7-b895-6537fec67c50 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:17.857990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aed985-9c52-4da7-b895-6537fec67c50 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:17.859953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 112/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:17.865255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:17.865669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:17.865842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:17.884590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:17.885784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:17.916189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef38f5a-b222-4af5-8bfe-7d824bbbda8f None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:17.916832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef38f5a-b222-4af5-8bfe-7d824bbbda8f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:17.917115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef38f5a-b222-4af5-8bfe-7d824bbbda8f None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:17.919698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 113/236] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:17.924881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:17.925160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:17.925439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:17.961057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 124/237] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:17.967582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:17.967582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:17.985763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.087211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016f573-70bd-4c3b-b8ad-b39d0a7a7e5e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:18.121984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be315-19a4-4966-8007-7343862dd957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:18.123122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be315-19a4-4966-8007-7343862dd957 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.123637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be315-19a4-4966-8007-7343862dd957 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.124221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633be315-19a4-4966-8007-7343862dd957 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.126076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 114/238] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:18.142221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633be315-19a4-4966-8007-7343862dd957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:18.150300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-633be315-19a4-4966-8007-7343862dd957 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:18.152068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 125/239] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:18.158164 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.174207 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be315-19a4-4966-8007-7343862dd957 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.318556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633be315-19a4-4966-8007-7343862dd957 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:18.354382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:18.355497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.356010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.356511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.357895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:18.359694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:18.361829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 126/240] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:18.368580 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.371168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0e061-4144-48e0-9a89-b1f946e7ee03 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:18.456779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:18.457458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.457737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.458056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.458817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:18.459440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:18.460583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:18.479058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 115/241] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:18.488542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41938d-e3eb-40ff-8462-7a05bb3bdf94 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:18.497292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.533161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127135db-97ed-4e12-8f8c-ff76ea8c188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:18.533850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127135db-97ed-4e12-8f8c-ff76ea8c188c None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.534137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127135db-97ed-4e12-8f8c-ff76ea8c188c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.534415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127135db-97ed-4e12-8f8c-ff76ea8c188c None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.535159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127135db-97ed-4e12-8f8c-ff76ea8c188c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:18.536632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127135db-97ed-4e12-8f8c-ff76ea8c188c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:18.574005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 127/242] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:18 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:18.626649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849f44f-65ab-4f26-9a8b-64193afd466b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:18.672363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e858ac-ba48-4699-802d-ecc3a1c764c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:18.673559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e858ac-ba48-4699-802d-ecc3a1c764c9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.674007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e858ac-ba48-4699-802d-ecc3a1c764c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.674435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e858ac-ba48-4699-802d-ecc3a1c764c9 None admin] PATH_INFO: `/v3/users/ee4a553dd1ff449580280abeb67a9e7a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.678691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd77a9b-be1d-443d-9dcb-52a76d390c9a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.680106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd77a9b-be1d-443d-9dcb-52a76d390c9a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.681066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd77a9b-be1d-443d-9dcb-52a76d390c9a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.685641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 128/243] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:18.692337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee775d-cb42-454f-bf70-b4bcc2afe225 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.692629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee775d-cb42-454f-bf70-b4bcc2afe225 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.692930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee775d-cb42-454f-bf70-b4bcc2afe225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.697313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e858ac-ba48-4699-802d-ecc3a1c764c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4a553dd1ff449580280abeb67a9e7a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:18.697920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e858ac-ba48-4699-802d-ecc3a1c764c9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:18.699854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 116/244] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:18 2022] GET /identity/v3/users/ee4a553dd1ff449580280abeb67a9e7a => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:18.701103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a202e-fa7e-42d8-b40c-68b559840182 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.701386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a202e-fa7e-42d8-b40c-68b559840182 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.701726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a202e-fa7e-42d8-b40c-68b559840182 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.709219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 117/245] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:18.709219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a202e-fa7e-42d8-b40c-68b559840182 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.720768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d5ee775d-cb42-454f-bf70-b4bcc2afe225 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:18.722447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d5ee775d-cb42-454f-bf70-b4bcc2afe225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:18.817724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 129/246] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:18.819563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.820180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.820464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.825575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a202e-fa7e-42d8-b40c-68b559840182 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:18.841686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:18.843158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:18.865834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:18.866492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:18.866775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:18.867042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:18.921145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 130/247] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:18.922678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:18.938166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:18.939679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.043647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb4a6a-72d3-4848-bdd2-b97620ab674c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.068259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 118/248] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:19.069898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.088955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef0ace-d8c0-495b-8a6f-8f162fb61d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.090316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0ace-d8c0-495b-8a6f-8f162fb61d97 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.090600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0ace-d8c0-495b-8a6f-8f162fb61d97 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.090876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef0ace-d8c0-495b-8a6f-8f162fb61d97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.101758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef0ace-d8c0-495b-8a6f-8f162fb61d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:19.109342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-c6ef0ace-d8c0-495b-8a6f-8f162fb61d97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:19.111636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 131/249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:19.112870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4309f-3a3b-4c0f-bf18-fca373c9ee88 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.113151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4309f-3a3b-4c0f-bf18-fca373c9ee88 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.113423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4309f-3a3b-4c0f-bf18-fca373c9ee88 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.115218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 132/250] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:19.115789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4309f-3a3b-4c0f-bf18-fca373c9ee88 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.188951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c94b9-45b3-4c95-b6a1-95af2eabb866 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.223090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a593-2aae-48db-aaae-c5f97368062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.223942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a593-2aae-48db-aaae-c5f97368062c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.224272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a593-2aae-48db-aaae-c5f97368062c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.224556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a593-2aae-48db-aaae-c5f97368062c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.235476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004a593-2aae-48db-aaae-c5f97368062c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:19.242605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-0004a593-2aae-48db-aaae-c5f97368062c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:19.244763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 119/251] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:19.246108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.246396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.246679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.251868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4309f-3a3b-4c0f-bf18-fca373c9ee88 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.264009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:19.265183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:19.295584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.296808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.297437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.297916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.299501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:19.301972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.303900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 133/252] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:19.310515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.335777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 120/253] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:19.336631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.439577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5eedf-e503-4b47-bdbc-9d66cdbbdf50 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.439918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d9707-5a8a-44c7-b282-e74630cb73e2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.477608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.478104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.478389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.478667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.479426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] RBAC: Adding query filter params (name=member) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:19.479788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:19.481222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.484289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.485195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.485679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.486551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.487862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:19.488377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:19.489152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 121/254] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:19.489940 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.490472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.501324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 134/255] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:19.502763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.590544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787fd02-e312-4e12-9ea7-21b5994e13be None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.630434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.631722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.632238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.632721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.632976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9e4f-7ae9-4e08-bfce-efbe1f646c3c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.634078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] RBAC: Adding query filter params (role.id=ebd6282f133340818c7bee6ee7efb357, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=ee4a553dd1ff449580280abeb67a9e7a) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:19.634767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:19.637291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.650933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 122/256] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/role_assignments?user.id=ee4a553dd1ff449580280abeb67a9e7a&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=ebd6282f133340818c7bee6ee7efb357 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:19.651565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.689091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.690510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.690744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.691022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.718523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:19.734309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:19.735794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 135/257] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:19.739316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.869501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4f06a-f8e7-4277-af7c-1a433b3454fc None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.893815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd0dd6-5625-4b63-8dc5-16d4b9d017ff None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:19.925179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.926072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.926359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.926636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] PATH_INFO: `/v3/users/e027e53e6b55417f897503d36c1714e8` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.927999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] RBAC: Authorizing `identity:get_user(user_id=e027e53e6b55417f897503d36c1714e8)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:19.935550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.935550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 123/258] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/users/e027e53e6b55417f897503d36c1714e8 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:19.935550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:19.947919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:19.948792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:19.949077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:19.949343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] PATH_INFO: `/v3/users/80358f37ebb443ee93baabcb79f29485` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:19.950583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] RBAC: Authorizing `identity:get_user(user_id=80358f37ebb443ee93baabcb79f29485)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:19.952095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:19.953772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 136/259] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/users/80358f37ebb443ee93baabcb79f29485 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:19.955512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.039254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63537fe-8b6c-46ea-b7c2-0b264a7c8988 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.077469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.078150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.078433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.078709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.081597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:20.081915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.083307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:20.104773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 124/260] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:20.105558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.142895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e17fe-420c-4f43-b80d-73d258e38740 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.178975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.179867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.180184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.180461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.185963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.187433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:20.189158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 137/261] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:19 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:20.191845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.261378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7448a-c6a8-4137-a847-1fa0eb1d381a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.301346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.303482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.303482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.303482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.363658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b36d3-b290-49ab-b6c9-0dc1fffb957a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.397518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.398393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.398673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.399480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] PATH_INFO: `/v3/users/80358f37ebb443ee93baabcb79f29485` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.403557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] RBAC: Authorizing `identity:get_user(user_id=80358f37ebb443ee93baabcb79f29485)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.403557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:20.403925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 138/262] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:20 2022] GET /identity/v3/users/80358f37ebb443ee93baabcb79f29485 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:20.404746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.454783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.456280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:20.502122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29f0c-25e3-407a-a94b-d5981066dc49 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.536051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.536862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.537144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.537417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/e027e53e6b55417f897503d36c1714e8/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.540040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3318f50544fb0b70f6cb196f14333, user_id=e027e53e6b55417f897503d36c1714e8, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.541559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:20.565754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 125/263] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:20.567942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.568419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 139/264] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:20 2022] PUT /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/e027e53e6b55417f897503d36c1714e8/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:20.572076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.688827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76bdd6-ede5-4452-a2d0-53189cbe63d3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.750346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.750346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.750346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.750683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.846788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef90f6-bc4f-4fb6-972e-b0da46b819dd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:20.891973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:20.893183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:20.893604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:20.894016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:20.895693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.897512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:20.899972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 140/265] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:20 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:20.905742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:20.906239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:20.907790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:21.019945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 126/266] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:21.023567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97940764-2b8a-44e9-9ba1-5f4c79353218 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:21.027082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:21.086769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:21.087847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.090291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.091312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.092400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=80358f37ebb443ee93baabcb79f29485) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:21.093021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:21.096020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:21.114976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 141/267] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:20 2022] GET /identity/v3/role_assignments?user.id=80358f37ebb443ee93baabcb79f29485&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:21.194771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17977f0-e722-4ccf-bd4d-e4156e31f9a8 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:21.242742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95506be1-af38-4268-9d34-377aaaff64e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:21.243969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95506be1-af38-4268-9d34-377aaaff64e5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.244401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95506be1-af38-4268-9d34-377aaaff64e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.244816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95506be1-af38-4268-9d34-377aaaff64e5 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.247341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95506be1-af38-4268-9d34-377aaaff64e5 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:21.249077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95506be1-af38-4268-9d34-377aaaff64e5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:21.251029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 127/268] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:21 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:21.257505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:21.386904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739914ac-017f-4636-b2de-84b4ad125c28 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:21.425990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:21.426928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.427578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.428018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.428996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] RBAC: Adding query filter params (role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=80358f37ebb443ee93baabcb79f29485) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:21.429463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:21.431137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e008eb3-416b-419f-86ed-3f5e56f63a7d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:21.440213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 142/269] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:21 2022] GET /identity/v3/role_assignments?user.id=80358f37ebb443ee93baabcb79f29485&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:21.821631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9285d-f2cb-44cd-b97c-9229aaa850c5 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.821940 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9285d-f2cb-44cd-b97c-9229aaa850c5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.822199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9285d-f2cb-44cd-b97c-9229aaa850c5 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.824271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 128/270] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:21.830264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.830555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.830839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.851332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:21.852626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:21.892880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768bf2-d21f-4dfe-a81b-7499ad5ea71a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.893203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768bf2-d21f-4dfe-a81b-7499ad5ea71a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.893437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768bf2-d21f-4dfe-a81b-7499ad5ea71a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.895330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 129/271] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:21.902203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:21.902493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:21.902770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:21.928559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:21.930984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:21.951629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 143/272] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:21.974160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.012016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 130/273] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:22.046495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.094360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96718a1d-134f-488e-84bf-c825448677a9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.132874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.134735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.135269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.135779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.146554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:22.154237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:22.157493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 144/274] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:22.163230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.166022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666a1c3-a234-44a3-9e6d-aee0c47ba2b0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.206108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.206905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.207187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.207467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.208655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:22.210541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:22.212871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 131/275] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:22.218329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.272930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958a103-d072-4e90-a052-e6e611a6930d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.308846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.309878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.310394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.310872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.311901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:22.312420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:22.314070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:22.320146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44539680-bc46-45f2-b4ca-d1f489063601 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.328856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 145/276] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:22.330299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.355572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.356246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.356778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.357062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.358103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:22.359895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:22.391668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 132/277] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:22 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:44:22.448767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81097e9-8419-4a80-92f7-801ce83ff8a8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.484868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97c090-0609-4b31-8fc2-27205f2c7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.486158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c090-0609-4b31-8fc2-27205f2c7245 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.486730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c090-0609-4b31-8fc2-27205f2c7245 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.487203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97c090-0609-4b31-8fc2-27205f2c7245 None admin] PATH_INFO: `/v3/users/b6f853d357f640b786c6449197e85812` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.502912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c090-0609-4b31-8fc2-27205f2c7245 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f853d357f640b786c6449197e85812)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:22.504821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97c090-0609-4b31-8fc2-27205f2c7245 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:22.506989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 146/278] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:22 2022] GET /identity/v3/users/b6f853d357f640b786c6449197e85812 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:22.513216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.622672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5605f8-7013-4574-8ef3-22266775ecd7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.655558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.656229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.656508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.656784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.657614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, user.id=b6f853d357f640b786c6449197e85812, scope.system=all) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:22.657922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:22.659372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5eea56-e754-4a62-b8bc-146f4605581a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:22.665469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 133/279] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Mar 29 15:44:22 2022] GET /identity/v3/role_assignments?user.id=b6f853d357f640b786c6449197e85812&scope.system=all&role.id=393e0469706749d1a4f1b2494247edea => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:22.674989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb37ca-3b6e-416e-81b9-7fbf475a3c7d None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.675277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb37ca-3b6e-416e-81b9-7fbf475a3c7d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.675600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb37ca-3b6e-416e-81b9-7fbf475a3c7d None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.677515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 147/280] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:22.684305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.684614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.684866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.703668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:22.704992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:22.789090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 134/281] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:22.814162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb37ca-3b6e-416e-81b9-7fbf475a3c7d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:22.932862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb37ca-3b6e-416e-81b9-7fbf475a3c7d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:22.972381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:22.973176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:22.973455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:22.973727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:22.984026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:22.991076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:22.992816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 148/282] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:22.998490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.119021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edf74c-05f3-4fae-af39-bb0de605413e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:23.159494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:23.160191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.160471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.160748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.161486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:23.161791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:23.163279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712913b-72a9-4df9-a146-be523370ca89 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:23.171395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 135/283] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:23.176961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.288061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d2f80-3740-4033-82b7-89498a796318 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.288701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d2f80-3740-4033-82b7-89498a796318 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.289251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d2f80-3740-4033-82b7-89498a796318 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.291483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 136/284] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:23.297969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.298503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.299138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.309404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90004d3d-b24e-488e-b517-0a17b0c8b88f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:23.319384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:23.321811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:23.368398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:23.369327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.369606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.369881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] PATH_INFO: `/v3/users/ee4a553dd1ff449580280abeb67a9e7a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.371148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4a553dd1ff449580280abeb67a9e7a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:23.372593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:23.379960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 149/285] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:23 2022] GET /identity/v3/users/ee4a553dd1ff449580280abeb67a9e7a => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:23.385346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.396336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 137/286] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:23.422769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.530502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df19c2-720b-44bc-8f66-661c7b54ea0d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:23.569365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:23.571190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.572034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.572520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.586147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fec304-033f-46c3-9f5b-c306093a5a74 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:23.586636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:23.595986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:23.597785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 138/287] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:23.604206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.676252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:23.677394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.677394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.677678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.678922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:23.680516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:23.683583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 150/288] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:23 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:23.689115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.719632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd647-267e-417b-b161-8addfae19718 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:23.767867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:23.769273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.769797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.770276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.771649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:23.772168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:23.774453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:23.786169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 139/289] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:23.794156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:23.808120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c60c-6a3e-44a4-88ee-fa05fc63d5b0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:23.866025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:23.866896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:23.867186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:23.867679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/ee4a553dd1ff449580280abeb67a9e7a/roles/ebd6282f133340818c7bee6ee7efb357` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:23.870413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3318f50544fb0b70f6cb196f14333, user_id=ee4a553dd1ff449580280abeb67a9e7a, role_id=ebd6282f133340818c7bee6ee7efb357)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:23.871887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:23.894818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 151/290] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:44:23 2022] PUT /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333/users/ee4a553dd1ff449580280abeb67a9e7a/roles/ebd6282f133340818c7bee6ee7efb357 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:23.965965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6bb2e-7bbe-45f2-bdc1-9bcdaef4cb72 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:24.010780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:24.018068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:24.019581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:24.020029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] PATH_INFO: `/v3/users/e027e53e6b55417f897503d36c1714e8` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:24.021687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] RBAC: Authorizing `identity:get_user(user_id=e027e53e6b55417f897503d36c1714e8)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:24.023261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:24.026017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 140/291] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:23 2022] GET /identity/v3/users/e027e53e6b55417f897503d36c1714e8 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:24.031827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:24.143502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1d4c0-398b-4a30-a86a-493201df1b69 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:24.181598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:24.182330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:24.182536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:24.182815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:24.249724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:24.251195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:24.348035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 152/292] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:24.356839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:24.494097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed6505-4599-4e0f-ae8f-65c0869887c4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:24.549528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8fe10-68e8-4f4b-b0ef-828ef2e73567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:24.550769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fe10-68e8-4f4b-b0ef-828ef2e73567 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:24.551277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fe10-68e8-4f4b-b0ef-828ef2e73567 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:24.551778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8fe10-68e8-4f4b-b0ef-828ef2e73567 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:24.553161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fe10-68e8-4f4b-b0ef-828ef2e73567 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:24.554884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c8fe10-68e8-4f4b-b0ef-828ef2e73567 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:24.556856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 141/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:24 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:24.562746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:24.720420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393388-87bc-46dd-b491-5023ce2bdd25 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:24.770233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:24.770902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:24.771232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:24.771511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:24.772366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=e027e53e6b55417f897503d36c1714e8) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:24.772676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:24.774679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332173f-a81a-475f-9c49-a93193f55066 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:24.784379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 153/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:24 2022] GET /identity/v3/role_assignments?user.id=e027e53e6b55417f897503d36c1714e8&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=393e0469706749d1a4f1b2494247edea => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:25.399373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e6ea-8b06-42ab-b250-16e5cc915745 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.399897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e6ea-8b06-42ab-b250-16e5cc915745 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.399972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e6ea-8b06-42ab-b250-16e5cc915745 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.401751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 142/295] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:25.407509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ebb5-318c-4629-9d54-b22a7982b7f1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.408009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ebb5-318c-4629-9d54-b22a7982b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.408086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08ebb5-318c-4629-9d54-b22a7982b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.490226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c870e-ab44-45bd-a64d-8932493365ac None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.490563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c870e-ab44-45bd-a64d-8932493365ac None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.490789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c870e-ab44-45bd-a64d-8932493365ac None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.492947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 143/296] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:25.498614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.499224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.499865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.556435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8d08ebb5-318c-4629-9d54-b22a7982b7f1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:25.557667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8d08ebb5-318c-4629-9d54-b22a7982b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:25.626402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 154/297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:25.628086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca644-c963-437e-aa35-68e23d264a3e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.628600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca644-c963-437e-aa35-68e23d264a3e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.629069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca644-c963-437e-aa35-68e23d264a3e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.631173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 155/298] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:25.633958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:25.635467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:25.636636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.637069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.637486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.653958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:25.655056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:25.703574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 144/299] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:25.704332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:25.735546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 156/300] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:25.735546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:25.811598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2903-d238-472a-b99e-1e36634b432c None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:25.841759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fbd06-78c6-408a-8200-997caa26ffbe None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:25.846755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:25.847608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.847896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.848170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.858058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:25.865161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:25.866389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 145/301] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:25.867201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:25.882604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:25.884455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:25.885044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:25.885467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:25.895478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:25.902918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:25.904690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 157/302] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:25.905683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:25.967581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d381e5-dd4b-4121-a54a-f997dd126dd9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.001079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.001983 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.002267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.002539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.003715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.005171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.008483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bbb49-7bd9-43ba-bc16-024be78dcd12 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.011851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 146/303] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:26.012736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.046863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.047560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.047849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.048122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.048873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:26.049199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.050806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.065081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 158/304] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:26.065081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.116408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5aad-6c30-48ca-8871-851e62c1f2a3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.155898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.156783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.157224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.157638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.158510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:26.158969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.160367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.161691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e98154-ff56-497b-9a00-cb58f9a4aa72 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.168432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 147/305] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:26.172767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.195914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.196585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.196877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.197160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] PATH_INFO: `/v3/groups` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.197844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.199289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.214461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 159/306] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Mar 29 15:44:26 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:26.215087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.306670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e4a4-f9a4-474d-a8f4-a74921a70cb1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.337478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfd222-e49e-493b-8b44-829eb89f887f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.355408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.356669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.356966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.357246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] PATH_INFO: `/v3/users/b6f853d357f640b786c6449197e85812` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.358520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f853d357f640b786c6449197e85812)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.360033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.363019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 148/307] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:26 2022] GET /identity/v3/users/b6f853d357f640b786c6449197e85812 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:26.368607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.384869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.386138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.386496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.386866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] PATH_INFO: `/v3/users/2a1a061f10d948ea8c92b2454a087601` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.406575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] RBAC: Authorizing `identity:get_user(user_id=2a1a061f10d948ea8c92b2454a087601)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.408124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.410004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 160/308] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:26 2022] GET /identity/v3/users/2a1a061f10d948ea8c92b2454a087601 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:26.415978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.481981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abef22-f8a4-4f35-b188-8a88545309c8 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.523546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083624-927d-4985-85a8-9d31ae945fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.525013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083624-927d-4985-85a8-9d31ae945fa9 None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.525364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083624-927d-4985-85a8-9d31ae945fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.525653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083624-927d-4985-85a8-9d31ae945fa9 None admin] PATH_INFO: `/v3/system/users/b6f853d357f640b786c6449197e85812/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.526823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356513e-ba5b-46c6-af39-961453ca9da2 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.527177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083624-927d-4985-85a8-9d31ae945fa9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b6f853d357f640b786c6449197e85812, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.528770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083624-927d-4985-85a8-9d31ae945fa9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.540931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 149/309] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Mar 29 15:44:26 2022] PUT /identity/v3/system/users/b6f853d357f640b786c6449197e85812/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:44:26.575283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.576047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.576333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.576715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.577569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] RBAC: Adding query filter params (role.id=ebd6282f133340818c7bee6ee7efb357, user.id=2a1a061f10d948ea8c92b2454a087601, scope.system=all) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:26.577930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:26.579430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c1ffb-d5fa-461a-a2fa-acc37bc3647f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:26.586003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 161/310] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Mar 29 15:44:26 2022] GET /identity/v3/role_assignments?user.id=2a1a061f10d948ea8c92b2454a087601&scope.system=all&role.id=ebd6282f133340818c7bee6ee7efb357 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:26.651941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86951674-b188-4771-8d4f-e98d58c0b579 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.652348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86951674-b188-4771-8d4f-e98d58c0b579 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.652698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86951674-b188-4771-8d4f-e98d58c0b579 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.655079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 150/311] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:26.661041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.661250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.661536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.680554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:26.681797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:26.763504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 162/312] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:26.784889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86951674-b188-4771-8d4f-e98d58c0b579 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:26.895852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86951674-b188-4771-8d4f-e98d58c0b579 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:26.930183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:26.930835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:26.931121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:26.931396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:26.941794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:26.949042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:26.950250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 151/313] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:26.956121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:27.057829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd136b-b7d1-422b-83dc-aeb78f7cc202 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:27.091380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:27.092084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:27.092373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:27.092649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:27.093400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:27.093711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:27.095138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:27.104101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 163/314] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:27.109636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:27.215750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29bc4-1124-4caf-afd0-103e32bb9cd3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:27.248127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:27.249044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:27.249375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:27.249660 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] PATH_INFO: `/v3/users/ee4a553dd1ff449580280abeb67a9e7a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:27.250857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] RBAC: Authorizing `identity:get_user(user_id=ee4a553dd1ff449580280abeb67a9e7a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:27.252331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:27.254247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 152/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:27 2022] GET /identity/v3/users/ee4a553dd1ff449580280abeb67a9e7a => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:27.260255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:27.360708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581336e-b33a-41d2-951a-cc84de4e4bc5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:27.396669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:27.397676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:27.398191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:27.399230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:27.470463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:27.471895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:27.570688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 164/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:27.576607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:27.673531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ee0c-fb24-485d-9e4d-55b5610cee64 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:27.711284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dca88a-0eb9-4393-8552-85e605eb5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:27.712911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dca88a-0eb9-4393-8552-85e605eb5586 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:27.712911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dca88a-0eb9-4393-8552-85e605eb5586 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:27.712911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dca88a-0eb9-4393-8552-85e605eb5586 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:27.715789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dca88a-0eb9-4393-8552-85e605eb5586 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:27.717370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dca88a-0eb9-4393-8552-85e605eb5586 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:27.719612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 153/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:27 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:27.728688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:27.829768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918f7c-073b-43d6-aa3a-c6b1fe1c74f0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:27.865438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:27.866486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:27.867583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:27.868076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:27.869242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] RBAC: Adding query filter params (role.id=ebd6282f133340818c7bee6ee7efb357, scope.project.id=e4d3318f50544fb0b70f6cb196f14333, user.id=ee4a553dd1ff449580280abeb67a9e7a) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:27.869754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:27.871386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585b407-1fea-43af-a30c-8977ef4f385a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:27.883642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 165/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:27 2022] GET /identity/v3/role_assignments?user.id=ee4a553dd1ff449580280abeb67a9e7a&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=ebd6282f133340818c7bee6ee7efb357 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:28.660931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc737-7e01-4ee1-bdbd-87a866067316 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:28.661456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc737-7e01-4ee1-bdbd-87a866067316 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:28.661531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc737-7e01-4ee1-bdbd-87a866067316 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:28.663334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 154/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:28.669859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93007d6-b1e9-449c-8802-d6f609b25fac None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:28.670393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93007d6-b1e9-449c-8802-d6f609b25fac None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:28.670468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93007d6-b1e9-449c-8802-d6f609b25fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:28.687678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b93007d6-b1e9-449c-8802-d6f609b25fac None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:28.688864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b93007d6-b1e9-449c-8802-d6f609b25fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:28.755801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 166/320] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:28.779673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc737-7e01-4ee1-bdbd-87a866067316 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:28.875305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc737-7e01-4ee1-bdbd-87a866067316 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:28.883060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dce0-549c-4fc0-9cc1-73b25e45cdf4 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:28.883346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dce0-549c-4fc0-9cc1-73b25e45cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:28.883800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0dce0-549c-4fc0-9cc1-73b25e45cdf4 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:28.885796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 167/321] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:28.890714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:28.891193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:28.891678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:28.908185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:28.909398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:28.909890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:28.910196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:28.910485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:28.910771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:28.912019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:28.913410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:28.915095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 155/322] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:28.920767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:28.977872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 168/323] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:28.999663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.021431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95126-1c4e-43c0-bd17-f15b8a2f6636 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.052810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daab9c-427e-44f3-a2db-3bc3a55452fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.053468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daab9c-427e-44f3-a2db-3bc3a55452fe None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.053753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daab9c-427e-44f3-a2db-3bc3a55452fe None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.054029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daab9c-427e-44f3-a2db-3bc3a55452fe None admin] PATH_INFO: `/v3/groups` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.055287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daab9c-427e-44f3-a2db-3bc3a55452fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.056742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2daab9c-427e-44f3-a2db-3bc3a55452fe None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.071046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 156/324] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Mar 29 15:44:28 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:44:29.072855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e44e-e5c6-4b86-b873-34f4f66a5c2c None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.073148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e44e-e5c6-4b86-b873-34f4f66a5c2c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.073428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e44e-e5c6-4b86-b873-34f4f66a5c2c None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.075292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 157/325] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:29.080799 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.081103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.081362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.099312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:29.100567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:29.102890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac0410-3290-4560-b81d-1e174e1f37d0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.138381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.139192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.139477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.139797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.152130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:29.159363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:29.161075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 169/326] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:29.171414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.186380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 158/327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:29.210207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.286476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8b7d-1245-4251-83ec-a3ea7a2f3ae0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.316640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cebd8-a18b-4b43-8bd4-add18b99a652 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.323141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.323851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.324136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.324420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.325169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:29.325481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.326872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.336121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 170/328] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:29.341588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.350545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.351929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.352217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.352493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.363024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:29.370146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:29.372193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 159/329] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:29.377866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.457000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c08be-1059-462b-9be6-53d5c311e60b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.496662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5dfbb-a772-46da-bf26-0d6a27137439 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.509094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.510028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.510309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.510630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] PATH_INFO: `/v3/users/2a1a061f10d948ea8c92b2454a087601` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.511964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] RBAC: Authorizing `identity:get_user(user_id=2a1a061f10d948ea8c92b2454a087601)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.513430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.515820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 171/330] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:29 2022] GET /identity/v3/users/2a1a061f10d948ea8c92b2454a087601 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:29.521847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.549490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.550167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.550447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.550724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.551474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] RBAC: Adding query filter params (name=member) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:29.551873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.553259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.563941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 160/331] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:29.569004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.648332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217b1a3-8bc7-47e8-9205-74354d8f458d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.682565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.683493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.683826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.684106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] PATH_INFO: `/v3/system/users/2a1a061f10d948ea8c92b2454a087601/roles/ebd6282f133340818c7bee6ee7efb357` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.685642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a1a061f10d948ea8c92b2454a087601, role_id=ebd6282f133340818c7bee6ee7efb357)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.687096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.689722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945e40-1d05-400c-b049-e5e9995c7f6d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.699201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 172/332] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Mar 29 15:44:29 2022] PUT /identity/v3/system/users/2a1a061f10d948ea8c92b2454a087601/roles/ebd6282f133340818c7bee6ee7efb357 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:29.727419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886434fc-51f0-45c6-ac32-2688ef0b1544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.728391 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886434fc-51f0-45c6-ac32-2688ef0b1544 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.728749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886434fc-51f0-45c6-ac32-2688ef0b1544 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.729025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886434fc-51f0-45c6-ac32-2688ef0b1544 None admin] PATH_INFO: `/v3/users/b6f853d357f640b786c6449197e85812` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.730272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886434fc-51f0-45c6-ac32-2688ef0b1544 None admin] RBAC: Authorizing `identity:get_user(user_id=b6f853d357f640b786c6449197e85812)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.731888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886434fc-51f0-45c6-ac32-2688ef0b1544 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.734043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 161/333] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:29 2022] GET /identity/v3/users/b6f853d357f640b786c6449197e85812 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:29.739788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:29.848505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1359c-a276-4dcf-be06-d46ce171a966 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:29.885855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:29.886521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:29.886809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:29.887086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:29.888026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] RBAC: Adding query filter params (role.id=393e0469706749d1a4f1b2494247edea, user.id=b6f853d357f640b786c6449197e85812, scope.system=all) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:29.888336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:29.889812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8b4dc-2710-40ad-9e96-329995ad98f1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:29.905158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 173/334] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Mar 29 15:44:29 2022] GET /identity/v3/role_assignments?user.id=b6f853d357f640b786c6449197e85812&scope.system=all&role.id=393e0469706749d1a4f1b2494247edea => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:31.979245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddda4a1-e688-4474-bb4b-c8947c4e84be None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:31.980262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddda4a1-e688-4474-bb4b-c8947c4e84be None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:31.980768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddda4a1-e688-4474-bb4b-c8947c4e84be None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:31.983108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 162/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:31.988046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd27b03-3b4d-4e0f-b261-5eb4764275a9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:31.988872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd27b03-3b4d-4e0f-b261-5eb4764275a9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:31.989366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd27b03-3b4d-4e0f-b261-5eb4764275a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.008607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ecd27b03-3b4d-4e0f-b261-5eb4764275a9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:32.010099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ecd27b03-3b4d-4e0f-b261-5eb4764275a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:32.089587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 174/336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:32.127117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddda4a1-e688-4474-bb4b-c8947c4e84be None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:32.217949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f63a3-2498-40b1-805b-9f3573b1b63c None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.218593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f63a3-2498-40b1-805b-9f3573b1b63c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.219072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f63a3-2498-40b1-805b-9f3573b1b63c None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.221153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 175/337] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:32.226533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.227095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.227597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.257624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddda4a1-e688-4474-bb4b-c8947c4e84be None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:32.265971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:32.267151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:32.323608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:32.324435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.324715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.324992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.339902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:32.347647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:32.349542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 163/338] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:32.356105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:32.406280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 176/339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:32.443471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:32.535412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271cb8c-7dbe-4732-8243-66ba8d25272e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:32.561487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacee35e-b6a4-4967-a5b6-bcf1c9c2e381 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:32.573805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:32.574483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.574769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.575051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.575852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:32.576169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:32.577567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb131-5196-461e-b53c-ad08b3da48af None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:32.587787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 164/340] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:32.589387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c15e69-d65b-4481-aebe-2ede77192c32 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.589681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c15e69-d65b-4481-aebe-2ede77192c32 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.590013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c15e69-d65b-4481-aebe-2ede77192c32 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.595970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 165/341] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:32.602073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.602367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.602651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.605962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:32.606777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.607057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.607332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.635186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:32.636499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:32.639864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:32.647220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:32.648815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 177/342] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:32.649386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:32.778874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 166/343] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:32.779806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:32.811148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56333-2976-48e1-9b90-f434b3bbc8b0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:32.882218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68edb-f118-4773-acc9-792965cef0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:32.882808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68edb-f118-4773-acc9-792965cef0ec None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.883092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68edb-f118-4773-acc9-792965cef0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.883367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68edb-f118-4773-acc9-792965cef0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.892586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286afae7-a503-4bfc-a563-a1ee2aa91310 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:32.931066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:32.931778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:32.932068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:32.932347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:32.933102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] RBAC: Adding query filter params (name=member) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:32.933415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:32.934798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:32.943729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 167/344] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:32.944592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.024639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af68edb-f118-4773-acc9-792965cef0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.026806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af68edb-f118-4773-acc9-792965cef0ec None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.045507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c4dce-c240-493f-a008-0cc1feaf0291 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.081941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.082757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.083049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.083334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.094799 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:33.101916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:33.103297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 168/345] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:33.103953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.154003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 178/346] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:33.155380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477f71-849b-4ffd-adde-a61b51d709af None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.155694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477f71-849b-4ffd-adde-a61b51d709af None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.155968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477f71-849b-4ffd-adde-a61b51d709af None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.158039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 179/347] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:33.159079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477f71-849b-4ffd-adde-a61b51d709af None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.205926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7a90-b78f-49a6-bd2f-982eb8f6c563 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.241017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e63cc8-ea03-4b7a-8d93-988d7353d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.242075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e63cc8-ea03-4b7a-8d93-988d7353d99a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.242368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e63cc8-ea03-4b7a-8d93-988d7353d99a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.242653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e63cc8-ea03-4b7a-8d93-988d7353d99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.264682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477f71-849b-4ffd-adde-a61b51d709af None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.299015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.299771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.300055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.300330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.301082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:33.301388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.302760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.311734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 180/348] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:33.312616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.313168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e63cc8-ea03-4b7a-8d93-988d7353d99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.314637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e63cc8-ea03-4b7a-8d93-988d7353d99a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.412755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd606-ebc6-47de-86cb-4edfbf3cc17d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.421291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 169/349] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:33.422417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.422711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.422989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.451492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:33.452725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:33.461049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.461925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.462212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.463334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.465173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.466917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.469736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 181/350] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:33.470583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.533798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 170/351] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:33.534930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.601597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa04c61-9504-46f1-ac53-3cc4806b932b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.636910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.637569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.637855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.638136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.645091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3515b78-515a-4a09-a33c-b6dca1b52a22 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.681264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.682055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.682333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.682606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.683816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.685271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.687272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 171/352] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:33.688088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.709857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.712537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.789899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582434-3f90-4414-8f4e-784e307c367b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.815483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 182/353] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:33.816376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.826024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.826882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.827162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.827441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.833630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.835094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.837651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 172/354] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:33.838707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.924285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e63ddd-339f-4747-8b55-dcd28acbb2ed None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.940110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5ed58-8b6f-4f9e-b8b8-a60401296799 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:33.958247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.959041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.959328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.959642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.970969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:33.975594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:33.976517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:33.976857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:33.977081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:33.978122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 29 15:44:33.978305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:33.979513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 183/355] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:33.979782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:33.980204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:33.981514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 173/356] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:33.982330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.100741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd419c52-e4c6-405b-8ba0-8d1a4a3ef6d6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.105165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb96ee-5f4f-4992-97c3-f92331b35986 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.143429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.144162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.144450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.144751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.145556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=6e53c7c9eba9492b9601de8600ce6616) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:34.145870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.147298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.149181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.150818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.151617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.152110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.153227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 174/357] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.154251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.160125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.161750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.164396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 184/358] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:33 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.168878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.278368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f467df-7335-4dad-ab1b-56d6a2121d5d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.281614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3999d3-0726-474b-b93b-d0cf3cacbafe None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.316945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.318011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.318517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.318844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.319101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.320297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.320736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.320958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=6e53c7c9eba9492b9601de8600ce6616) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:34.321164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.321637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.322253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:34.322722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.323452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b89ece-c55f-4119-a2c6-1ed68d855532 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.324485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.330000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 175/359] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=393e0469706749d1a4f1b2494247edea => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.331709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05700ca-e361-43cd-aa8c-c65a08bf566a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.332224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05700ca-e361-43cd-aa8c-c65a08bf566a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.332716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05700ca-e361-43cd-aa8c-c65a08bf566a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.334746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 176/361] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:34.334897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 185/361] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.339583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.341961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.342686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.343163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.378994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:34.380592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:34.453298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eed339-4b08-4d28-b358-6ef32bf8f4c4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.464970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 177/362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:34.465854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.490881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a4a4-55a7-4215-904b-40627c6f04cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.492329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a4a4-55a7-4215-904b-40627c6f04cb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.492616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a4a4-55a7-4215-904b-40627c6f04cb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.492929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a4a4-55a7-4215-904b-40627c6f04cb None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.494141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a4a4-55a7-4215-904b-40627c6f04cb None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.495659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a4a4-55a7-4215-904b-40627c6f04cb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.497673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 186/363] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.498964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f6a6-56be-4bf5-a360-c9efd1936e42 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.499274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f6a6-56be-4bf5-a360-c9efd1936e42 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.499554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f6a6-56be-4bf5-a360-c9efd1936e42 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.501300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 187/364] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:34.504260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f6a6-56be-4bf5-a360-c9efd1936e42 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.609969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ce03f-d88a-4588-8835-b0aba4923132 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.642406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f6a6-56be-4bf5-a360-c9efd1936e42 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.653093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6300c-af6d-4ed4-90a4-e1130be1e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.654114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6300c-af6d-4ed4-90a4-e1130be1e0cd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.654295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6300c-af6d-4ed4-90a4-e1130be1e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.654537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6300c-af6d-4ed4-90a4-e1130be1e0cd None admin] PATH_INFO: `/v3/users/2a1a061f10d948ea8c92b2454a087601` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.655789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6300c-af6d-4ed4-90a4-e1130be1e0cd None admin] RBAC: Authorizing `identity:get_user(user_id=2a1a061f10d948ea8c92b2454a087601)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.657242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6300c-af6d-4ed4-90a4-e1130be1e0cd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.659197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 178/365] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/users/2a1a061f10d948ea8c92b2454a087601 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.660462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.660756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.661038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.681890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:34.682101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.683073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:34.683356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.683861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.684343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.685374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=e4d3318f50544fb0b70f6cb196f14333) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:34.685895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.687597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.693937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 188/366] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=393e0469706749d1a4f1b2494247edea => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:34.699937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.792644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 179/367] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:34.793549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:34.930435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a363-9bdc-4ef6-ac80-d0b3a15d0431 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.941857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4298cb-53ea-4412-a301-31d7075d756e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:34.972621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.973279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.973564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.973838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.974680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] RBAC: Adding query filter params (role.id=ebd6282f133340818c7bee6ee7efb357, user.id=2a1a061f10d948ea8c92b2454a087601, scope.system=all) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:34.975018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:34.976474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:34.986829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:34.987963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:34.988452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:34.988947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:34.995675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 180/368] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/role_assignments?user.id=2a1a061f10d948ea8c92b2454a087601&scope.system=all&role.id=ebd6282f133340818c7bee6ee7efb357 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:34.996684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.001945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:35.011483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:35.013447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 189/369] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:35.019708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.161820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8e5da-3d18-4745-b6dd-cf4e70c27d45 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.167570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b732a6-3951-4cd1-82bc-73cfd6be1a92 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.198349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.199454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.200017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.200513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.201476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:35.202002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:35.203625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:35.213364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 190/370] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:35.217153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.218098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.218396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.218678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.219785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.235295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:35.243097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:35.244369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 181/371] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:35.265383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.334510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49deea3-83be-4f93-9b1f-86baf8287c92 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.373017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.373916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.374373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.374807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.404494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe96874-9a51-4c90-a46b-6e8309c7d141 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.439620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.440636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.441152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.441616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.442558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:35.443054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:35.444616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:35.444839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:35.446406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:35.459192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 182/372] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:35.463035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.583494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 191/373] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:35.591950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.598546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e765c6-5509-4a17-914c-34dd7e18c6c0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.638067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.638963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.639384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.640375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.750864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8bd00-3e65-4966-bb1a-3524b15bb96a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.761590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:35.763109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:35.795962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.796831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.797108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.797379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.799328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:35.800814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:35.802490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 192/374] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:35.809267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.946452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec69b8f-ff30-46a2-a94a-6eabd3b7e5bf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:35.984171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 183/375] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:35.988301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:35.989345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:35.992748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:35.993189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:35.994367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:35.999922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:36.001826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:36.011997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 193/376] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:36.027707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:36.143639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb8eee-612e-4c6c-b4fd-37ac631b1698 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:36.196393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:36.197299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:36.197584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:36.197854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] PATH_INFO: `/v3/projects/8676a22b20704599967d071e06718ce0` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:36.199570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] RBAC: Authorizing `identity:get_project(project_id=8676a22b20704599967d071e06718ce0)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:36.201018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:36.202718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 184/377] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:35 2022] GET /identity/v3/projects/8676a22b20704599967d071e06718ce0 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:36.209128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:36.232856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a2584-9a4d-4b47-bc66-8d0b194fd000 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:36.295682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:36.296265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:36.296541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:36.296814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:36.297641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=e4d3318f50544fb0b70f6cb196f14333) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:36.297953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:36.299399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:36.312875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 194/378] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:36 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:36.363141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cecae-c805-4b5e-9c89-a2e1273e8146 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:36.411120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e8aa4-5fe8-464a-8e36-53784a763e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:36.412095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e8aa4-5fe8-464a-8e36-53784a763e69 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:36.412382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e8aa4-5fe8-464a-8e36-53784a763e69 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:36.412657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e8aa4-5fe8-464a-8e36-53784a763e69 None admin] PATH_INFO: `/v3/groups/ff20523a4df146f6add1e5c3fe090bf4` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:36.425280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e8aa4-5fe8-464a-8e36-53784a763e69 None admin] RBAC: Authorizing `identity:get_group(group_id=ff20523a4df146f6add1e5c3fe090bf4)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:36.426588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e8aa4-5fe8-464a-8e36-53784a763e69 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:36.428375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 185/379] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:36 2022] GET /identity/v3/groups/ff20523a4df146f6add1e5c3fe090bf4 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:36.434630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:36.547985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03410b5-9946-457d-a884-e34fa896b0c0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:36.582687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:36.583519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:36.583832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:36.584100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:36.584930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] RBAC: Adding query filter params (group.id=ff20523a4df146f6add1e5c3fe090bf4, role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=8676a22b20704599967d071e06718ce0) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:36.585349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:36.586837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd821d-0551-4a90-8a23-41c358db1c16 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:36.593256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 195/380] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:36 2022] GET /identity/v3/role_assignments?group.id=ff20523a4df146f6add1e5c3fe090bf4&scope.project.id=8676a22b20704599967d071e06718ce0&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:37.129911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61e83f-239b-4de2-8f80-e55ed6c69ce0 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.130586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61e83f-239b-4de2-8f80-e55ed6c69ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.131062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61e83f-239b-4de2-8f80-e55ed6c69ce0 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.133922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 186/381] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:37.139278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.139826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.140294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.157324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:37.158804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:37.234686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 196/382] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:37.271936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61e83f-239b-4de2-8f80-e55ed6c69ce0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:37.382138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61e83f-239b-4de2-8f80-e55ed6c69ce0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:37.421440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8098f-9c4c-4ccb-8a4d-b35b0a67e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:37.422599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8098f-9c4c-4ccb-8a4d-b35b0a67e7b8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.423073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8098f-9c4c-4ccb-8a4d-b35b0a67e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.423559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8098f-9c4c-4ccb-8a4d-b35b0a67e7b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.436237 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8098f-9c4c-4ccb-8a4d-b35b0a67e7b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:37.443836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-2df8098f-9c4c-4ccb-8a4d-b35b0a67e7b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:37.445642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 187/383] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:37.451193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:37.556931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6072f-192b-408b-9976-30c6b74bddf6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:37.573200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722142-7c57-4fda-a2e2-39a64df81e7a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.574086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722142-7c57-4fda-a2e2-39a64df81e7a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.574827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722142-7c57-4fda-a2e2-39a64df81e7a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.584763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 188/384] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:37.591445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.591989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.592495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.594947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:37.595647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.595926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.596190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.596941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:37.597315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:37.598832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:37.608412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 197/385] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:37.613812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:37.632646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:37.634170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:37.717179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2bdb5f-1bcf-4c9a-934c-596b5c77b0e6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:37.746219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 189/386] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:37.755327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420341d-121e-454d-9104-5815380e972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:37.756431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420341d-121e-454d-9104-5815380e972c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.757440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420341d-121e-454d-9104-5815380e972c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.757867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420341d-121e-454d-9104-5815380e972c None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.759222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420341d-121e-454d-9104-5815380e972c None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:37.760909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420341d-121e-454d-9104-5815380e972c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:37.762987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 198/387] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:37 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:37.770488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:37.791008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420341d-121e-454d-9104-5815380e972c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:37.899576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420341d-121e-454d-9104-5815380e972c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:37.909793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08421590-97d5-4038-b23e-6ffa376927dd None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:37.938699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:37.939942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.940618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.941087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.952420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:37.960494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:37.962233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 199/388] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:37.966038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:37.966909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:37.967188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:37.967459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:37.974579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:37.974579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:37.976217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 190/389] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:37 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:37.977829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:37.981576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.083892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1f896-53e7-47a1-8ac0-a252e7f5e692 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.096904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb4eaf-4f25-404d-8f95-eca1c7eba14c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.119087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0617c5-7723-4642-98eb-272dfc05146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.120349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0617c5-7723-4642-98eb-272dfc05146a None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.120349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0617c5-7723-4642-98eb-272dfc05146a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.120541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0617c5-7723-4642-98eb-272dfc05146a None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616/groups/475ac75a47a64a56b5b41a98795c5379/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.122575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0617c5-7723-4642-98eb-272dfc05146a None admin] RBAC: Authorizing `identity:create_grant(project_id=6e53c7c9eba9492b9601de8600ce6616, group_id=475ac75a47a64a56b5b41a98795c5379, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.124052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0617c5-7723-4642-98eb-272dfc05146a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.139856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.141166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.141738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.142221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.142333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 191/390] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Mar 29 15:44:37 2022] PUT /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616/groups/475ac75a47a64a56b5b41a98795c5379/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:44:38.143277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:38.143674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e838-9bbd-48b9-882b-37cbc2a638a4 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.144014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e838-9bbd-48b9-882b-37cbc2a638a4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.144206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.144299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e838-9bbd-48b9-882b-37cbc2a638a4 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.145892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.146192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 192/391] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:38.152146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337c53-5424-453b-9a40-90760144ae91 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.153661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337c53-5424-453b-9a40-90760144ae91 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.157131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13337c53-5424-453b-9a40-90760144ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.165721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 200/392] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:38.172568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.189472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-13337c53-5424-453b-9a40-90760144ae91 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:38.193360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-13337c53-5424-453b-9a40-90760144ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:38.338159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389275a-4aa3-4988-b6a0-61c659273d45 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.339037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 193/393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:38.374931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337c53-5424-453b-9a40-90760144ae91 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.382192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.383081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.383367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.383697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.388379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.389896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.391659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 201/394] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:38 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:38.398860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.500176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13337c53-5424-453b-9a40-90760144ae91 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.513889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cb23-0c41-46c4-a6f5-aaf03f3a27a1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.535066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.536246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.536739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.537201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.548018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.548907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.549164 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:38.549266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.549449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.550661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.552151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.554220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 202/395] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:38 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:38.557506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:38.559241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 194/396] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:38.560549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.568651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.671351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00322c1-f24c-4ccb-bfee-322eb9a546a4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.683440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97027c5-c21b-46e1-8087-ed1b97f256f3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.705004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.705890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.706176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.706451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616/groups/475ac75a47a64a56b5b41a98795c5379/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.708706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e53c7c9eba9492b9601de8600ce6616, group_id=475ac75a47a64a56b5b41a98795c5379, role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.710198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.717980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.718656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.718939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.719218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.720020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] RBAC: Adding query filter params (name=member) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:38.720370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.721822 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.725476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 203/397] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Mar 29 15:44:38 2022] PUT /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616/groups/475ac75a47a64a56b5b41a98795c5379/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:38.732852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 195/398] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:38.739401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:38.883284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7dc04-ee78-4cda-b605-8b9045f89bd5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:38.923442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:38.924365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:38.924650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:38.924936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:38.926158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:38.927666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:38.934576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 204/399] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:38 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:38.936665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:39.061919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcb046-a7db-4d6e-b1c8-4a3f9a9190bb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:39.102014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636ce3-aa76-47fa-95db-413fed5ee44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:39.103256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636ce3-aa76-47fa-95db-413fed5ee44f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:39.103777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636ce3-aa76-47fa-95db-413fed5ee44f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:39.104278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636ce3-aa76-47fa-95db-413fed5ee44f None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:39.105654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636ce3-aa76-47fa-95db-413fed5ee44f None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:39.107278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636ce3-aa76-47fa-95db-413fed5ee44f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:39.109493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 196/400] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:38 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:39.114954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:39.240011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a613e-d50e-4a7f-bd47-a98c887265eb None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:39.279038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622347b0-a19a-4a1f-a0b5-97a189bd3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:39.279990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622347b0-a19a-4a1f-a0b5-97a189bd3f35 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:39.280339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622347b0-a19a-4a1f-a0b5-97a189bd3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:39.280619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622347b0-a19a-4a1f-a0b5-97a189bd3f35 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333/groups/475ac75a47a64a56b5b41a98795c5379/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:39.289000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622347b0-a19a-4a1f-a0b5-97a189bd3f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3318f50544fb0b70f6cb196f14333, group_id=475ac75a47a64a56b5b41a98795c5379, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:39.290478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622347b0-a19a-4a1f-a0b5-97a189bd3f35 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:39.309376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 205/401] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Mar 29 15:44:39 2022] PUT /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333/groups/475ac75a47a64a56b5b41a98795c5379/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:39.531967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d6a7-e627-4b73-85d4-ad5a5ba2e348 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:39.532961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d6a7-e627-4b73-85d4-ad5a5ba2e348 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:39.533463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1d6a7-e627-4b73-85d4-ad5a5ba2e348 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:39.535698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 197/402] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:39.541585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:39.542062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:39.542131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:39.568026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:39.569758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:39.663787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 206/403] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:39.688910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d6a7-e627-4b73-85d4-ad5a5ba2e348 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:39.815064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1d6a7-e627-4b73-85d4-ad5a5ba2e348 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:39.857347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:39.858531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:39.859008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:39.859475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:39.872956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:39.880672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:39.883008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 198/404] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:39.888721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.032477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8bfd3-0996-431b-9fbc-7e34d46ba5c5 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.073786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.074381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.074669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.074946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.075733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:40.076042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:40.077427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2b9bf-cde2-4dc4-9eb9-2211e8b49fa0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:40.091316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 207/405] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:40.097431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.117194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9003aa-627d-4a2d-b51f-1e1d2848cd9c None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.117194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9003aa-627d-4a2d-b51f-1e1d2848cd9c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.117194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9003aa-627d-4a2d-b51f-1e1d2848cd9c None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.117194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 208/406] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:40.121491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.121776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.122055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.154289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:40.156572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:40.270713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 209/407] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:40.296217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.301404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7796762-57f8-4c9d-b63c-0999c5584bea None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.357128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.358335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.358810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.359287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.360697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:40.362342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:40.365603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 199/408] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:40 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:40.371161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.431297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0655865-a8fa-45c0-b093-f93f5e08bded None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.496510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.498353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.503372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.503905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.521183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:40.529223 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:40.535305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 210/409] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:40.542892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.561593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7fdc1-801b-470b-b35f-8b89a7e60d90 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.629083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.630283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.630760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.631226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.632740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:40.634974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:40.641369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 200/410] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:40 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:40.647048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.670030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7129662-8fed-4f44-a122-bfa8275824b7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.711574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.712393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.712674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.715228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.716020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:40.716330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:40.717707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:40.735398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 211/411] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:40.745080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.843252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec6295-33a0-4bd4-b189-6ca56f063930 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.855013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7ccc0-5709-4635-a0cd-a5d7ee33453e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:40.896745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.898548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.899182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.900540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] PATH_INFO: `/v3/groups/ff20523a4df146f6add1e5c3fe090bf4` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.902843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] RBAC: Authorizing `identity:get_group(group_id=ff20523a4df146f6add1e5c3fe090bf4)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:40.905318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:40.908327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:40.909457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:40.909933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:40.910425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333/groups/475ac75a47a64a56b5b41a98795c5379/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:40.911580 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 212/412] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:40 2022] GET /identity/v3/groups/ff20523a4df146f6add1e5c3fe090bf4 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:40.913653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:40.916283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3318f50544fb0b70f6cb196f14333, group_id=475ac75a47a64a56b5b41a98795c5379, role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:40.919629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:40.943845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 201/413] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Mar 29 15:44:40 2022] PUT /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333/groups/475ac75a47a64a56b5b41a98795c5379/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:44:41.078482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0594ed7-4deb-4e62-82d3-dd3f51968afd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:41.132615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66055-b713-4b94-8db7-d9ac99ee3bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:41.133508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66055-b713-4b94-8db7-d9ac99ee3bea None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.133791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66055-b713-4b94-8db7-d9ac99ee3bea None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.134066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66055-b713-4b94-8db7-d9ac99ee3bea None admin] PATH_INFO: `/v3/projects/8676a22b20704599967d071e06718ce0` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.135457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66055-b713-4b94-8db7-d9ac99ee3bea None admin] RBAC: Authorizing `identity:get_project(project_id=8676a22b20704599967d071e06718ce0)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:41.136885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66055-b713-4b94-8db7-d9ac99ee3bea None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:41.138903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 213/414] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:40 2022] GET /identity/v3/projects/8676a22b20704599967d071e06718ce0 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:41.145196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:41.284241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a053a8b-ed91-47d6-8b3b-7fb10e56ae80 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:41.320962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b3c4-5a18-4bd2-a7a1-4bf1f49dffb2 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.321267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b3c4-5a18-4bd2-a7a1-4bf1f49dffb2 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.321514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b3c4-5a18-4bd2-a7a1-4bf1f49dffb2 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.323280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 214/415] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:41.328689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.328975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.329255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.350755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:41.352331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:41.358016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:41.358957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.359238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.359517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] PATH_INFO: `/v3/projects/8676a22b20704599967d071e06718ce0/groups/ff20523a4df146f6add1e5c3fe090bf4/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.361488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] RBAC: Authorizing `identity:create_grant(project_id=8676a22b20704599967d071e06718ce0, group_id=ff20523a4df146f6add1e5c3fe090bf4, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:41.362929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:41.387965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 202/416] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Mar 29 15:44:41 2022] PUT /identity/v3/projects/8676a22b20704599967d071e06718ce0/groups/ff20523a4df146f6add1e5c3fe090bf4/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:44:41.425714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 215/417] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:41.450774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:41.604244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827ebb-5274-4cd4-8ab2-7da174d754fe None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:41.639835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f0cd-52a1-4d01-a9c2-1756cefb986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:41.640970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f0cd-52a1-4d01-a9c2-1756cefb986e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.641446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f0cd-52a1-4d01-a9c2-1756cefb986e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.641932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f0cd-52a1-4d01-a9c2-1756cefb986e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.652215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f0cd-52a1-4d01-a9c2-1756cefb986e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:41.659404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-9751f0cd-52a1-4d01-a9c2-1756cefb986e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:41.661098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 203/418] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:41.667737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:41.730627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9ac4-c6e5-4fc1-b70f-3b2ed655795b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.731232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9ac4-c6e5-4fc1-b70f-3b2ed655795b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.731764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9ac4-c6e5-4fc1-b70f-3b2ed655795b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.734044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 204/419] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:41.738848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.739406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.739920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.766312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:41.767751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:41.777701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fd315-6322-4488-a33b-585797cb2d4d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:41.814102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:41.815170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.815615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.816186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:41.817613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:41.818070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:41.820325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:41.834254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 216/420] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:41.837278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:41.909873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 205/421] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:41.940196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be1c05-0954-475f-9b96-b134994b0314 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:41.944596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:41.975046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:41.976053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:41.976477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:41.976890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.044591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:42.046335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:42.144264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 217/422] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:42.151131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:42.191184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751bf55-1ed9-4893-ac7f-184fa745045a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:42.255945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d12df-b481-4847-96b8-cbc8ea9f3f70 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:42.289705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:42.290537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.290824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.291101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.295680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:42.296831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.297307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.297785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.299165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:42.300933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:42.302903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 218/423] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:42 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:42.308540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:42.312384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:42.330021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:42.331845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 206/424] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:42.337609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:42.409348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e9dd5-3c51-4398-b971-c0e7309b1618 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:42.442959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:42.444751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.445251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.445713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.447082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:42.448784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:42.450872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 219/425] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:42 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:42.456719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:42.548718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7447a-9c91-437a-9a13-b159c2a22cae None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:42.558386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1144ba8-7cf1-41ad-bcc2-9dd30693f600 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:42.591344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:42.592061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.592342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.594220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.594220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:42.594220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:42.595468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:42.620091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 207/426] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:42.628714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:42.645156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:42.645822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.646105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.646379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.647781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=6e53c7c9eba9492b9601de8600ce6616) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:42.648095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:42.649546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1e6b9-f930-4bd0-be2a-4902f861ac57 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:42.662002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 220/427] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:42 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=393e0469706749d1a4f1b2494247edea => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:42.695233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb37ad2-f82b-4dec-89c6-93cf883367cb None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.695868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb37ad2-f82b-4dec-89c6-93cf883367cb None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.695868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb37ad2-f82b-4dec-89c6-93cf883367cb None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.698135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 221/428] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:42.703831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.704223 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.704509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.740693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:42.742455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:42.749392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe658c1-c048-4ed3-907f-4f086b96b6a4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:42.787314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:42.788048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:42.789612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:42.789906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:42.860017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 222/429] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:42.893716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:42.910268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:42.911815 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.003051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f52a4-f7ee-4977-81c7-cce6ec098f10 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.015637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 208/430] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:43.020820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.040303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.041389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.041389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.041582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.052662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:43.060283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 29 15:44:43.061827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 223/431] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:43.067273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.135273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad162c29-7ab4-4391-8a25-c165cab6af00 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.178690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bf14b-b99b-4eb8-92ba-57174fc5ca1a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.180809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.181675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.181954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.182228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] PATH_INFO: `/v3/projects/6e53c7c9eba9492b9601de8600ce6616` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.183480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=6e53c7c9eba9492b9601de8600ce6616)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.185002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.188068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 209/432] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/projects/6e53c7c9eba9492b9601de8600ce6616 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:43.197765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.228577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.229251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.229530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.229803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.230557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:43.230860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.232263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.241558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 224/433] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:43.252440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.326810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83248286-d476-4231-ab35-a2dfafa45eb5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.365654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed5284-a4be-4ba7-8ac2-fcdb11f34d18 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.367445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.368347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.368630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.368910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.370209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.371709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.373701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 210/434] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:43.389551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.410687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fc0a9-ad6f-47d4-9fc8-4bdd4771e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.411751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc0a9-ad6f-47d4-9fc8-4bdd4771e232 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.412040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc0a9-ad6f-47d4-9fc8-4bdd4771e232 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.412314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fc0a9-ad6f-47d4-9fc8-4bdd4771e232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.490389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc0a9-ad6f-47d4-9fc8-4bdd4771e232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.492833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fc0a9-ad6f-47d4-9fc8-4bdd4771e232 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.510927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5893-2728-41ea-8aef-3fcde53efedf None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.548330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.549028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.549320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.549601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.550445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=6e53c7c9eba9492b9601de8600ce6616) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:43.550764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.552272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.560748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 211/435] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=6e53c7c9eba9492b9601de8600ce6616&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:43.608495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 225/436] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:43.614021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.724652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaf100-c871-4eef-8838-ae02ee428eb3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.761460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.762541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.764799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34a34c-21d6-459f-a2e0-5415956ed975 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.764799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34a34c-21d6-459f-a2e0-5415956ed975 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.764799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34a34c-21d6-459f-a2e0-5415956ed975 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.767690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.767896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 226/437] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:43.768049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.769019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.770478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.772399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 212/438] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:43.776240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.776240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.776240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.777547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.795874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:43.797088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:43.887698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 227/439] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:43.900470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b5cb2-3f4b-4bf0-9a9c-048623070ba0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:43.911437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:43.941159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:43.942026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:43.942314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:43.942594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:43.944767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:43.946216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:43.948214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 213/440] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:43.954802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.034783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5be7-5174-411d-9789-f76ee77d96e6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.080989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba88300-16c5-4f7a-a9b3-73373a9afd63 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.083487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.084340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.084692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.084975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.095657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:44.103434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:44.104875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 228/441] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:44.110598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.117984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.118652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.118942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.119224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.120122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=393e0469706749d1a4f1b2494247edea, scope.project.id=e4d3318f50544fb0b70f6cb196f14333) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:44.120440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.121882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb0e6-61b5-4717-a24e-4642fc9d3e10 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.128160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 214/442] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:43 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=393e0469706749d1a4f1b2494247edea => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:44.175964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b24001-3746-4515-84a3-93dbe6041f74 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.176261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b24001-3746-4515-84a3-93dbe6041f74 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.176437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b24001-3746-4515-84a3-93dbe6041f74 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.178384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 215/443] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:44.183727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.184064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.184283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.202713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:44.203953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:44.230535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f252d-b3f3-4850-b724-3031114126dc None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.269544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.270232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.270518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.270798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.271922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:44.272546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.274007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.287102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 229/444] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:44.287285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 216/445] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:44.288444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.295543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.394270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939651-805e-4623-9a78-843f071acdcc None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.408105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813a67-f0de-4a33-a899-9da6362ed232 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.427734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.428834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.429127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.429429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.444548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.445635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.446135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.446558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.456919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:44.464716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:44:44.465898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 217/446] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:44.472175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.502665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.504204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.571212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47defc-4153-45de-ae34-84fa8cfc4b99 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.598530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 230/447] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:44.602901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.603851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.604063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.604158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.604397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.605137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:44.605444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.606810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.614725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 218/448] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:44.620165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.693338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fb3cf-aae6-47f8-8bb5-bafc46ea3741 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.712673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1013-f72f-471e-b8ab-33c65dea17e7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.725133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.726017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.726305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.726576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] PATH_INFO: `/v3/projects/e4d3318f50544fb0b70f6cb196f14333` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.727808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] RBAC: Authorizing `identity:get_project(project_id=e4d3318f50544fb0b70f6cb196f14333)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.729244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.730913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 231/449] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/projects/e4d3318f50544fb0b70f6cb196f14333 => generated 302 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:44.736178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.744297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.744950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.745235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.745514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.809086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.810536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.827936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845fce7-0d42-4041-8a96-a2636e0b2421 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.859810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.860654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.860931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.861203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] PATH_INFO: `/v3/groups/475ac75a47a64a56b5b41a98795c5379` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:44.862357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] RBAC: Authorizing `identity:get_group(group_id=475ac75a47a64a56b5b41a98795c5379)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:44.863809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:44.865388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 232/450] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/groups/475ac75a47a64a56b5b41a98795c5379 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:44.871497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.909740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 219/451] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:44.916164 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:44.967028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a1c9c-24c3-4bd0-97a8-d021b4d5b3a4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:44.998381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:44.999021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:44.999300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:44.999594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:45.000412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] RBAC: Adding query filter params (group.id=475ac75a47a64a56b5b41a98795c5379, role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=e4d3318f50544fb0b70f6cb196f14333) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:45.000716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:45.002143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:45.008154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 233/452] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/role_assignments?group.id=475ac75a47a64a56b5b41a98795c5379&scope.project.id=e4d3318f50544fb0b70f6cb196f14333&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:44:45.008551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611895f1-f3a6-4641-b273-86ad181dcbb2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:45.043770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:45.044641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:45.044922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:45.045195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] PATH_INFO: `/v3/projects/8676a22b20704599967d071e06718ce0` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:45.046448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] RBAC: Authorizing `identity:get_project(project_id=8676a22b20704599967d071e06718ce0)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:45.047963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:45.049715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 220/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:44:44 2022] GET /identity/v3/projects/8676a22b20704599967d071e06718ce0 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:45.055918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:45.155596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c74494-0625-45ca-9fc7-93455d591e7d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:45.190435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b22be-7c35-42b5-b988-3b7e964c0e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:45.191293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b22be-7c35-42b5-b988-3b7e964c0e83 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:45.191599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b22be-7c35-42b5-b988-3b7e964c0e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:45.191874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b22be-7c35-42b5-b988-3b7e964c0e83 None admin] PATH_INFO: `/v3/groups/ff20523a4df146f6add1e5c3fe090bf4` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:45.193065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b22be-7c35-42b5-b988-3b7e964c0e83 None admin] RBAC: Authorizing `identity:get_group(group_id=ff20523a4df146f6add1e5c3fe090bf4)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:45.195065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b22be-7c35-42b5-b988-3b7e964c0e83 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:45.196705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 234/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Mar 29 15:44:45 2022] GET /identity/v3/groups/ff20523a4df146f6add1e5c3fe090bf4 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:45.202491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:45.299193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95ecff-38a8-4ef1-825d-15064698b41a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:45.337400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:45.338561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:45.338850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:45.339130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:45.340092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] RBAC: Adding query filter params (group.id=ff20523a4df146f6add1e5c3fe090bf4, role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=8676a22b20704599967d071e06718ce0) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:45.340401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:45.341847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302e1a5-b581-4c8f-850b-a62325b8f440 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:45.347958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 221/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Mar 29 15:44:45 2022] GET /identity/v3/role_assignments?group.id=ff20523a4df146f6add1e5c3fe090bf4&scope.project.id=8676a22b20704599967d071e06718ce0&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:48.475552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0d169-806b-4bcd-9358-9473c448a19b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.475552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0d169-806b-4bcd-9358-9473c448a19b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.475552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0d169-806b-4bcd-9358-9473c448a19b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.476933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 235/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:48.480318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c99bdc-3910-4514-ae22-04bbc634957e None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.481105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c99bdc-3910-4514-ae22-04bbc634957e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.481595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c99bdc-3910-4514-ae22-04bbc634957e None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.481695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.481886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.482168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.484130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 222/457] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:48.489068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807636-be8a-4b8c-9bdd-2f049f8bd943 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.489565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807636-be8a-4b8c-9bdd-2f049f8bd943 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.490066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807636-be8a-4b8c-9bdd-2f049f8bd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.508555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:48.509774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:48.510851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-5a807636-be8a-4b8c-9bdd-2f049f8bd943 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:48.512207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5a807636-be8a-4b8c-9bdd-2f049f8bd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:48.591638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 223/458] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:48.593137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1de4-4a21-4357-b9bf-1f719e1a8a93 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.593429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1de4-4a21-4357-b9bf-1f719e1a8a93 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.593713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1de4-4a21-4357-b9bf-1f719e1a8a93 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.595455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 224/459] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:48.603023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.603023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.603023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.607225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 236/460] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:48.613271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:48.625366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:48.626543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:48.693039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 225/461] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:48.694322 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:48.738041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0909d8d-b4ff-4943-a8d5-a58bec9c19e4 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:48.775502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:48.776321 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.776599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.777403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.786878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:48.788585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:48.806185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067739d-7e83-41bd-aeef-2f1585626e80 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:48.806666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:48.812342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 237/462] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:48.812342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:48.843110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:48.843950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.844232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.844511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.854550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:48.856274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:48.873903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-c488c633-e78c-499f-a385-2169adc6ba2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:48.875264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 226/463] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:48.876707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b192497-88ae-4a2f-9a4d-2552fae2d892 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.877194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b192497-88ae-4a2f-9a4d-2552fae2d892 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.877636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b192497-88ae-4a2f-9a4d-2552fae2d892 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.879430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 227/464] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:48.880445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b192497-88ae-4a2f-9a4d-2552fae2d892 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:48.913929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9924a-3828-432d-a1fb-59b2f9b2221d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:48.946414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:48.947264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:48.947755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:48.948085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:48.958024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:48.960351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:48.977446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:48.978813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 238/465] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:48.979515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:48.985573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b192497-88ae-4a2f-9a4d-2552fae2d892 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.022296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.022859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.023143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.023425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.024187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:49.024508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.025900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01a284-b6d4-4660-98e4-9c081475589b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.042614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 228/466] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:49.044050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.044341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.044616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.062392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:49.063598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:49.078844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558d175-8fc5-4a45-9f64-61820351dbd1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.111711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.112372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.112653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.112931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.113658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:49.113962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.115334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.126451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 239/467] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:49.127501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.133649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 229/468] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:49.134484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.226831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973861-c2ba-4239-b05a-138f6ba86fb8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.246531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada13c38-104a-4a23-bb2b-4eb9411c4dd8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.259485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.260169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.260460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.260740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.261459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:49.261768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.263146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.276533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 240/469] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:49.277079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.285298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.286034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.286325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.286889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.287330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.288896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.315557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 230/470] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:49.315557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.389808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b604-a985-4ad6-8c12-d5e27875892a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.429449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.430185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.430469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.430770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.431483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.432896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc83254-396c-4274-8cd5-ae4d8ce81a09 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.433028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.463562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 241/471] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:49.463562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.495558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.495558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.495558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.495558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.506840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.508340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.527726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-50e4d43b-1457-42b1-819a-e3135b9c5cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:49.529246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 231/472] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:49.530525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342d4ed-8ffd-4045-8d23-462d2a498934 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.530873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342d4ed-8ffd-4045-8d23-462d2a498934 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.531160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342d4ed-8ffd-4045-8d23-462d2a498934 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.533268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 232/473] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:49.538663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.539256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.539579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.558291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:49.560308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:49.576649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91207e4-0a4a-4651-a906-e00a73978d9e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.624004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.624860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.625240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.625610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.626429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.628096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.650574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 233/474] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:49.651831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.656980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 242/475] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:49.682731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.809156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007acee-c9df-4878-8735-92cbb1f6f1a2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.826000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5440b-8bda-4c07-8230-56f51baa1cd9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:49.853661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.854215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.854498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.854771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.855499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:49.855854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.857775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.870319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:49.871279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:49.871597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 234/476] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:49.872084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:49.872367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:49.873129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:49.874520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:49.877479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:49.884754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.sql.core [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 29 15:44:49.884754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 29 15:44:49.884754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [parameters: {'id': '2bf5819237884a939287c5c35f24f3f8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 29 15:44:49.884754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79739) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 29 15:44:49.901226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 29 15:44:49.902760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 243/477] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:49.908345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:50.021191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bb0c-a8eb-450d-93c6-da33b46ff52c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:50.025000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a99da8-2f5e-400a-8a3a-aa11418a0ef8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:50.065844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:50.066433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:50.066718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:50.066997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:50.067727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:50.069712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:50.070571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda28f9-722a-4cc5-ba73-2bd7f88878fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:50.071377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda28f9-722a-4cc5-ba73-2bd7f88878fe None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:50.071688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda28f9-722a-4cc5-ba73-2bd7f88878fe None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:50.071962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda28f9-722a-4cc5-ba73-2bd7f88878fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:50.091351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda28f9-722a-4cc5-ba73-2bd7f88878fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:50.102876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-bfda28f9-722a-4cc5-ba73-2bd7f88878fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 29 15:44:50.106654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 235/478] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:49 2022] POST /identity/v3/users => generated 249 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:50.107302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 244/479] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:44:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:50.117854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:50.257283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a235279-4048-4839-bcb4-1eca61f2603b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:50.297719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:50.298768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:50.299286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:50.299888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:50.300859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:50.301371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:50.303486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34554482-f0e2-405a-9f64-0f71fdd3bf7f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:50.313322 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 236/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:52.038841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45b5f-e280-49ef-9cb3-323adb7bfd7e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.039346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45b5f-e280-49ef-9cb3-323adb7bfd7e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.039346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a45b5f-e280-49ef-9cb3-323adb7bfd7e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.041331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 245/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:52.046934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.047378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.047489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.064514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:52.065712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:52.164468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 237/482] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:52.194340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45b5f-e280-49ef-9cb3-323adb7bfd7e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.329308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a45b5f-e280-49ef-9cb3-323adb7bfd7e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:52.380867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b25135-9673-438d-9ebf-40e43898271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:52.381690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25135-9673-438d-9ebf-40e43898271b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.381974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25135-9673-438d-9ebf-40e43898271b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.382248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25135-9673-438d-9ebf-40e43898271b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.397725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b25135-9673-438d-9ebf-40e43898271b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:52.404772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-a0b25135-9673-438d-9ebf-40e43898271b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:52.411603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 246/483] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:52.414020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.421144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2ccd-961b-4133-aaef-f2a17c55f7e3 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.421431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2ccd-961b-4133-aaef-f2a17c55f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.421710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2ccd-961b-4133-aaef-f2a17c55f7e3 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.423789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 247/484] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:52.428669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c095f62-ef3e-4b43-8d47-5d73eace86c2 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.428981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c095f62-ef3e-4b43-8d47-5d73eace86c2 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.429220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c095f62-ef3e-4b43-8d47-5d73eace86c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.460629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6c095f62-ef3e-4b43-8d47-5d73eace86c2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:52.461841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6c095f62-ef3e-4b43-8d47-5d73eace86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:52.542934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57c6b-5124-4873-878f-8ecce1ff6cbc None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:52.543882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 248/485] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:52.545271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f345a-6eb0-405e-8957-0810df8e9926 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.545558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f345a-6eb0-405e-8957-0810df8e9926 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.545888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f345a-6eb0-405e-8957-0810df8e9926 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.555825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 249/486] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:52.557214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.557501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.557781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.584376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:52.585459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:52.591031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:52.591747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.592034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.592315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.593072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:52.593389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:52.594771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:52.603682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 238/487] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:52.604533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.659726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 250/488] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:52.660589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.718935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398025b-a9a1-4a8e-925e-d293cc1980d6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:52.758750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:52.758750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.758750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.758750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.776219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:52.776311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18b6c1-20c0-4203-a58b-80634a33da04 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:52.776387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:52.776387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 239/489] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:52.776387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.801645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:52.802437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.802772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.803551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.814485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:52.816019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:52.834310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:52.840014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 251/490] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:52.840817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.881568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff24b0-3f75-4ef8-8ca1-c3f9157075ce None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:52.915854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:52.917236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.917534 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.917783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.931874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:52.940286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:52.942025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 240/491] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:52.942908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:52.957005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189ad8-5640-428f-8869-e5503db00170 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:52.995371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:52.996121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:52.996400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:52.996726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:52.997488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:52.997794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:52.999188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.009169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 252/492] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:53.010069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.054694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ae6b1-f609-42b5-9bbb-d7e22c891f98 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.089170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.089831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.090167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.090389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.091118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:53.091423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.092858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.105420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 241/493] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:53.106279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.117592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d2f6a-6e8d-44a4-be12-824664f27a54 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.152628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.153307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.153595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.153867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.154626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:53.154931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.156426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.165119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 253/494] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:53.165960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.208513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a34f-b368-4d6d-b0f1-5f814516c968 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.243331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.244173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.244457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.244738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.255208 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.256752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.274131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:53.275502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708376c-4362-41bd-98f1-ba26c33f0bd6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.279966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 242/495] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:53.280880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.310929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.311809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.312091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.312518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.321169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.322656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.336556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:44:53.337998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 254/496] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:53.338758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.383829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3161b-0213-4a4e-b7fb-e38f399b4d20 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.416045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.417108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.417389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.417659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.428293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.429739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.437343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787903a7-bfdb-48ad-bc8b-0eacfc9c6290 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.446442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-4cae0639-b7c3-4d4b-b9d2-8022204a9e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:53.452372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 243/497] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:53.452372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22d3a-8d57-4a00-bc91-aae69e907e18 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.452372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22d3a-8d57-4a00-bc91-aae69e907e18 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.452372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22d3a-8d57-4a00-bc91-aae69e907e18 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.452372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 244/498] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:53.452372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab22d3a-8d57-4a00-bc91-aae69e907e18 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.479568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.479568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.479568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.479568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.479979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:53.480257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.481634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.499453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 255/499] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:53.499453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.570871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab22d3a-8d57-4a00-bc91-aae69e907e18 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.595311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08df93-7b24-46ed-b446-f48fb61bb123 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.603616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.604293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.604575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.604849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.605685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:53.605996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.607449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.627045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.627735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.628022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.628302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.629025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:53.629333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.630698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c603524-e0bf-4361-bfbd-86b181f56a50 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.645282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 256/500] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:53.645425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 245/501] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:53.645540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f6a6-e3ee-4e89-bf50-ce0c89a33917 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.645540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f6a6-e3ee-4e89-bf50-ce0c89a33917 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.645540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f6a6-e3ee-4e89-bf50-ce0c89a33917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.645715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.661439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f857f6a6-e3ee-4e89-bf50-ce0c89a33917 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:53.662671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f857f6a6-e3ee-4e89-bf50-ce0c89a33917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:53.724101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 257/502] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:53.725925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cddf4-57ea-4e07-8e13-ab7a060d411e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.726218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cddf4-57ea-4e07-8e13-ab7a060d411e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.726491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4cddf4-57ea-4e07-8e13-ab7a060d411e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.728331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 258/503] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:53.729623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cddf4-57ea-4e07-8e13-ab7a060d411e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.742655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34234f-760f-4de1-ab51-9d613f9c218d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.778198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.779040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.779324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.779631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.786442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.788453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.801787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 15:44:53.803002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 246/504] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:53.808170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:53.826117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4cddf4-57ea-4e07-8e13-ab7a060d411e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.860858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.861649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.861930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.862207 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.869838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:53.871314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:53.885548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-8c932a16-c6de-42f8-9026-903c83705588 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 29 15:44:53.886728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 259/505] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:53.887964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.888253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.888528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.900572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f2dd6-2e55-4ca1-bc6d-4b747adf398b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:53.905192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:53.906368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:53.932407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:53.933044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:53.933325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:53.933623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:53.969595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 260/506] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:53.970435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.000616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.002068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.063817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe2c5c-19b0-423d-9497-622bf60aac3a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.094077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 247/507] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:54.095487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.095626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.096408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.096688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.096961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.106769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:54.113698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:54.114874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 261/508] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:54.116254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.188864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758354ec-6dc2-4eef-8d38-293f6881f6eb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.208299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3edcd9-aa90-4fa6-96d1-6179b8d85225 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.220597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.221374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.221661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.221948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.222773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:54.223083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.225077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.239968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.240685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.240967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.241248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.241384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 248/509] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:54.242077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:54.242179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.242388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.243847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.282581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 262/510] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:54.283423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.343288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e143b-1b9e-498e-a79a-d7dbca315a58 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.376730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.377517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.377797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.378070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.378412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367fa52-e6e5-43fe-b197-e6c90062f5ee None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.388161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.389624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.406401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:54.407589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 249/511] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:54.408353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.411703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.412535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.412824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.413102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.422767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.424273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.440561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:54.441680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 263/512] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:54.442473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.502185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a545-68f7-41f1-b94d-41f735a0455d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.534409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.535066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.535350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.535657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.536401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:54.536584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15b306-d69e-42ab-a768-b382169069bf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.536711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.538126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.545648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 250/513] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:54.546431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.567738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.568889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.569172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.569441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.632157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.633621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.645689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eea000-19c6-4eee-a92e-3384d4c769d0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.678212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.678721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.679000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.679268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.725291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:54.726135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.741680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.743129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.817774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725e860-5f22-4e5b-ba88-2aee692d522d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.835569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 251/515] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:54.836415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.851308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.852198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.852485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.852759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.853479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:54.853784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.855162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.866398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 265/516] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:54.866985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.929855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afade77d-1c95-4606-8016-58d052feacc5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.958145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebff15-2904-4a09-8795-32fc0d4b4109 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:54.961431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.962083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.962364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.962904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:54.963626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:54.963930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:54.965301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:54.976428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 252/517] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:54.977147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:54.990936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:54.991755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:54.992043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:54.992324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.002442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.003963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.020225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:55.021462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 266/518] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.022242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.070917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4a4d6-80b6-4414-8acb-6c8e81e83ec9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.102517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.103308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.103618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.103897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.113664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b3a62-7db2-40b9-9875-1c7319a80af5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.113871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.115364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.132254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:55.133451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 253/519] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.134205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.146070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.146913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.147194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.147468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.157410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.158862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.174802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:55.175990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 267/520] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.176750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.231959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434b1f-7624-448f-a7dd-0ec45bb0fa87 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.263083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.263763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.264049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.264327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.265023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.266448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.269159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25e43e-07cf-4bd2-8834-5f5c89105773 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.285294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 254/521] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:44:55 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:44:55.286287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.313958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.314829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.315049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.315325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.322715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.324333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.338858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:44:55.340195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 268/522] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.341013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.395789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b311459-6ed6-4355-a6ed-6b892d880ec6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.431107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.431810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.432093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.432365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.433102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:55.433394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.434795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.443479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd74aa5-c119-4d30-9965-b8e03f41798a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.451413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 255/523] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:55.451413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.481045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.481718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.482628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.482628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.482984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:55.483291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.484720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.496128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 269/524] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:55.496755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.553962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff06-bb1a-4ae6-a075-5e98776e2bef None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.587551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.588745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.589217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.589493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.590212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:55.590517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.591917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.594183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8312ad1-6317-44b1-8053-b34932382294 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.603331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 256/525] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:55.604213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.631835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.632507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.632794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.633075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.633866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:55.634179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.635671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.658030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 270/526] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:55.658030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.701260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d5f2-b36e-4c1e-a1fe-1ce9c60b0a8f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.734284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.734906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.735192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.735471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.743029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.744823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.756810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ce96e-c8b2-4172-8b29-a06a47671836 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.761793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 29 15:44:55.766910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 257/527] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.767785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.789967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.790768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.791061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.791340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.797936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.799400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.812387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:44:55.813724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 271/528] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.814413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.864241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb51b2-f483-4221-bc68-2b4ac3017a7c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.903012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.903855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.904139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.904413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.911517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.913291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.918178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b28e-8da1-4a7f-90b9-05351eaee53c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:55.927064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:44:55.935561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 258/529] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:55.935561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:55.951745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:55.952400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:55.952690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:55.952972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:55.953795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=ba546b8ade2443a096e7f303d609b622) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:55.954111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:55.955573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:55.961619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 272/530] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/role_assignments?user.id=ba546b8ade2443a096e7f303d609b622&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:55.962941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.032077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8857a-e2ad-4bed-9fd7-a78cd6ae3a2d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.068542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.068980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.069264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.069537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.070385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:56.070699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.072243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.076292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa08d4b-4dee-4a87-8139-f0327df880dc None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.095152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 259/531] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:56.095152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.119483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.119836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.120127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.120401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.121205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:56.121513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.123076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.136937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 273/532] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:44:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:56.137880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.201020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d07acf-18d0-4776-8229-6ff78b95a596 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.236265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.237274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.237782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.238255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.239235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:56.239423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad27ca-5c01-47f4-b105-e33fe06db1e2 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.240495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.242155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.265626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 260/533] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:56.266855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.274218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.274866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.275148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.275420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.342536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.343946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.374498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7921036-ac29-43be-a5fc-4b87e3ee9423 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.408734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.409752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.410237 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.410716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.411818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=f956c2a9dfbd40fbabd043c371e579e7) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:56.412383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.414071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.420142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 261/534] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/role_assignments?user.id=f956c2a9dfbd40fbabd043c371e579e7&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:56.421169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.455744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 274/535] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:44:56.465761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.530704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fa012-85f4-4bfa-a201-cb088f880bf6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.567586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.568714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.569249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.569727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.570770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=6b029906da704309ad9b8da03b51c054) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:56.571285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.573085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.579376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 262/536] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/role_assignments?user.id=6b029906da704309ad9b8da03b51c054&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:56.667221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39444d-d5b8-43ea-9b9e-25647f538687 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.721424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.722615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.723102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.727737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.739604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.741548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.768527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:56.769830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 275/537] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:56.775663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:56.881769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e9733-4017-49b0-ad1a-1d244902d23d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:56.917167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:56.917898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:56.918127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:56.918417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:56.919137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:56.919447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:56.920858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:56.933793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 263/538] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:56.938887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:57.066098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573860db-98e9-4dc2-b766-b31cc6f39834 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:57.108281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:57.109081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:57.109362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:57.109638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:57.120673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:57.122148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:57.138049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:44:57.139581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 276/539] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:57.144843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:57.249561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431d649-d32a-4f02-93f3-d1bbcdec6902 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:57.284019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:57.284745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:57.285034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:57.285312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:57.286107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:57.286424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:57.287936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb037e5b-0c10-4d04-aacd-f1d72ffdc3aa None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:57.299923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 264/540] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:57.308718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:57.470116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f050-6f17-40c1-ae59-982c32e629f7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:57.507174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:57.507790 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:57.508075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:57.508356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:57.509193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=aa8ff0744fac48fd8dca772e998701ef) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:57.509506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:57.510953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2051f8f-004e-4f60-854d-1253bd054c81 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:57.517033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 277/541] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:44:57 2022] GET /identity/v3/role_assignments?user.id=aa8ff0744fac48fd8dca772e998701ef&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:57.845136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ae3f-074a-4be9-965f-bbbcb5edff6d None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:57.845594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ae3f-074a-4be9-965f-bbbcb5edff6d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:57.845975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ae3f-074a-4be9-965f-bbbcb5edff6d None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:57.847950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 265/542] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:57.853018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:57.853309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:57.853590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:57.871981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:57.873198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:57.958239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 278/543] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:44:58.006320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ae3f-074a-4be9-965f-bbbcb5edff6d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:58.146149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ae3f-074a-4be9-965f-bbbcb5edff6d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:58.183637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:58.184435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.184719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.184994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.195596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:58.202495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:58.203992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 266/544] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:58.209822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:58.306100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c2dc3-3959-4bdd-9831-2b7c8b4a6900 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:58.342151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:58.342864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.343090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.343362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.344141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:58.344445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:58.345816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:58.354511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 279/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:44:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:58.359896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:58.466449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bb95-70db-4b53-aa43-d522824a2a45 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:58.500878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:58.501671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.501955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.502232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.513317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:58.514792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:58.531141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:58.532682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 267/546] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:58.538232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:58.639189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf2001-ba75-4064-b1ff-693902520d46 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:58.672842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:58.673511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.673796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.674074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.674798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:58.675107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:58.676514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:58.690554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 280/547] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:58.696034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:58.796965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244df94-1258-4a53-af2b-75835ab1d1b1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:58.830867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:58.831697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.831979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.832256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.840765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:58.842239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:58.855588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-e0c417ac-ae8a-46d1-935c-da54fcfd1707 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 15:44:58.857063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 268/548] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:44:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:58.862575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:58.916491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3716-b2fc-469a-9d75-0d3a9d4910ca None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.916817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3716-b2fc-469a-9d75-0d3a9d4910ca None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.917097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3716-b2fc-469a-9d75-0d3a9d4910ca None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.918928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 269/549] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:44:58.924038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:58.924326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:58.924606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:58.944605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:58.946595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:59.027750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88c5e-738d-4b33-b570-9ae61d772f93 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.028052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 270/550] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:59.080446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.092300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.092996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.093305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.093570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.094414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:59.094726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:59.096195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:59.129939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 281/551] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Mar 29 15:44:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:59.135459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.179168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f2f2-1348-45e7-a9c0-b059a1ba2c01 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.213601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.214404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.214687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.214962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.225412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:59.232432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:59.233968 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 271/552] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:44:59.240288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.330343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a598e-b597-4616-8b10-1bd98fb0ff25 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.374000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d64c-dc5f-45f4-9db4-69aafa6807ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.374650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d64c-dc5f-45f4-9db4-69aafa6807ad None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.374925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d64c-dc5f-45f4-9db4-69aafa6807ad None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.375202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d64c-dc5f-45f4-9db4-69aafa6807ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.385047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b691c1-4aa5-4d23-ba60-2a64bc7026da None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.430303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.430971 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.431255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.431548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.432296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:59.432602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:59.433963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74e908-5e35-4260-b780-9490b9795b75 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:59.441688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 272/553] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:59.442932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803611-f7b9-4a2f-a3b1-a216b26208e4 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.443227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803611-f7b9-4a2f-a3b1-a216b26208e4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.443505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803611-f7b9-4a2f-a3b1-a216b26208e4 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.447143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 273/554] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:59.447143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861df12-74b2-4b9f-a7c0-26f82e2f5c94 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.447143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861df12-74b2-4b9f-a7c0-26f82e2f5c94 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.447143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861df12-74b2-4b9f-a7c0-26f82e2f5c94 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.448873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 274/555] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:44:59.449753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861df12-74b2-4b9f-a7c0-26f82e2f5c94 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.456067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d64c-dc5f-45f4-9db4-69aafa6807ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:59.457746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d64c-dc5f-45f4-9db4-69aafa6807ad None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:59.555248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 282/556] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 29 15:44:59.557037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.557575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.557939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861df12-74b2-4b9f-a7c0-26f82e2f5c94 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.558254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.574561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:59.575775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:59.593414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.594559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.595056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.595432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.606285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:59.607768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:59.623905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f44bf396-5ed3-46d0-8d52-21a7b6b34cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:59.625254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 275/557] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:59.628795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.629089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.629366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.641687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 283/558] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:59.651670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.658335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:44:59.659967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:44:59.728648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 276/559] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:44:59.732445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.760760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6693d73-ac82-47f0-90c5-aebf84ef0059 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.794463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.795285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.795603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.795880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.805732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:59.807215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:59.829517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:44:59.830728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 284/560] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:59.830728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.840588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f46f30-49be-49ec-b79d-d38170776c8e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.876399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.877252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.877569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.877816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.878709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:44:59.879306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:44:59.880774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:44:59.900042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 277/561] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:44:59.900042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:44:59.927900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55b0d-dcba-4174-beea-69603f589e48 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:44:59.965360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:44:59.965360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:44:59.965360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:44:59.965711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:44:59.976383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:44:59.983692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:44:59.989409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 285/562] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:44:59.989409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.007029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28ff18-cfc7-454b-92ba-cc15929bc322 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.039777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.040578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.040864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.041145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.051063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:00.058537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:00.059954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 278/563] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:00.060750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.092182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7799d8-7e20-4508-b898-afaa5ca69506 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.130425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.131010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.131294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.131597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.132322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:00.132631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.134083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.145467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 286/564] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:00.146808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.168051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ddff-5fce-4a49-822b-e12d973c0d67 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.200843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.201659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.201941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.202219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.210091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.211740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.224964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:45:00.230736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 279/565] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:00.230736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.242495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4d4e-dabd-4d41-9a57-bf619c300205 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.275782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.276459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.276747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.277024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.277773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:00.278086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.279452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.287434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 287/566] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:00.288590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.326493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbf396-16aa-4146-95ea-92a3601a4367 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.360599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.361565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.362040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.362506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.363444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:00.363929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.366033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.374138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 280/567] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:00.375011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.391041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717b4e2-c531-4ab7-a88c-e27a163a5972 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.424870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.425925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.426357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.426777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.433935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.435389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.449252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:00.450412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 288/568] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:00.451177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.476903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fac652-ed2c-4c57-89e2-404977fd67ae None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.508728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.509386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.509667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.509939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.510765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:00.511073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.512526 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.529946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 281/569] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:00.530552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.543955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac00c-8658-437f-b403-decebabcf71e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.575369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.576170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.576449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.576717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.586571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.588288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.604231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9ce48aea-7198-41be-a900-2d29f2f10202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:00.605397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 289/570] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:00.606557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f25e24-1257-4fa0-b52e-21419538348b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.606837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f25e24-1257-4fa0-b52e-21419538348b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.607108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f25e24-1257-4fa0-b52e-21419538348b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.608899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 290/571] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:00.610887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f25e24-1257-4fa0-b52e-21419538348b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.622491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45241c-2cf3-43b7-ac87-0db8e3345ccf None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.657641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.658354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.658637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.658909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.669097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.670555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.687039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:00.688231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 282/572] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:00.688995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.709134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f25e24-1257-4fa0-b52e-21419538348b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.741091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.741749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.742031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.742307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.743088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:00.743397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.744884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.756648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 291/573] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:00.757403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.785385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6a1d5-b9e8-42da-bd0f-f743a7fdb316 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.818920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.819730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.820015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.820290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.829786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.831234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.847505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-56048922-6b7e-4a9e-9dc6-b7cceeb1ba8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:00.848662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c709ee-2762-40c9-ae4a-187b451005e0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:00.848767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 283/574] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:00.849818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.850103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.850379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.866204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:00.867385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:00.884293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:00.884951 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:00.885236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:00.885514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:00.886231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:00.886544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:00.887937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:00.899170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 292/575] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:00.899980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:00.931900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 284/576] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:00.932670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.007219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757664a9-f262-4665-ae1a-fd5de5bbd0b5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.026177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12145a75-dd60-46f2-b9d2-27167a2a9397 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.038642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.039303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.039613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.039890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.040611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.040916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.042280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.058557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.059228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.059701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.059985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.060341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 293/577] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.060826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=7152e01448494ebd98eb204c3e602a77) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.061139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.061278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.062597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.083564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 285/578] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:00 2022] GET /identity/v3/role_assignments?user.id=7152e01448494ebd98eb204c3e602a77&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.083564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.166903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd253a84-7c32-408c-902b-66759a99c0bf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.175649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fa40f-133e-42c1-840a-48eaced850e9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.200914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.201588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.201938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.202286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.203090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.203461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.204959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.212228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.213378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.213659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.213933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] PATH_INFO: `/v3/users/glance` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.218682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 294/579] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.221797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.223285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.223775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.238062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 29 15:45:01.244022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 286/580] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:01.244022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.320198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe0123-5898-434c-8c35-f34010f4153e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.340090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a126c1a-c479-423c-9ea0-99734d64b9bf None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.357360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.358204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.358701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.359200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.371774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:01.378658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:01.379582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.384544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 295/581] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:01.384690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.384690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.384855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.384946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.392087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.393554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.407992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 15:45:01.414519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 287/582] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:01.414519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.482548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0d491-9955-4ee3-8685-9256e9dee9ed None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.508065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce64124-9ea2-4d36-8274-fa711c064ba9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.514816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.515807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.516091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.516365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.523464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.524974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.538628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:01.544365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 296/583] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:01.544365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.545280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.545947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.546228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.546507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.548090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.548090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.549080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.565780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 288/584] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.566545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.638592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f7f9f-2a3e-4b0c-bb02-e46b42f906cf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.662127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113df4c-c9a3-4d82-921f-d6596e4f2c24 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.672532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.673194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.673478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.673757 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.674504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.674809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.676220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.684417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 297/585] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.685445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.695508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.696197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.696483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.696761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.697587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.697894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.699306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.721417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 289/586] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.721417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.793148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c930ff-d73d-4f64-8cd8-6c4d469bd35f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.823614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af999cd-b7f4-4357-845d-5f439223b81c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.831275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.832360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.832649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.832926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.834128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:01.834440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.836499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.856003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 298/587] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:01.856003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.861805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.862607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.862890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.863167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.874531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.875980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:01.893255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:01.899064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 290/588] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:01.899916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:01.951946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6ebf-6139-4754-828c-7f83542bf997 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:01.986876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:01.987704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:01.987990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:01.988271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:01.998071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:01.999557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.002666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be06c22-a85a-40da-9be4-17160ee7cd36 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.016315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:02.017434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 299/589] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:02.018182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.040723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.041512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.041796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.042072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.052302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.053817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.071136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:02.076710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 291/590] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:02.076710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.117968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4de72-5179-4014-b6e6-8fab73b17589 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.151347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.152279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.152563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.152840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/ba546b8ade2443a096e7f303d609b622/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.166253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=ba546b8ade2443a096e7f303d609b622, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.167749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.178077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416761f4-5ead-4cb6-9808-9f9bce5880cc None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.191718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 300/591] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:02 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/ba546b8ade2443a096e7f303d609b622/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:02.191718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.219011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.219730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.220014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.220292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.221036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:02.221347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.222861 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.236141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 292/592] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:02.237020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.306718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a437d-61b8-479e-a569-5d6638faee80 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.344849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e69f2-0472-49a7-94f6-c58bbb4eda1a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.347233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.348090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.348450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.348798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.350176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:02.350555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.352087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.365387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 301/593] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:02.366457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.381641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.382313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.382598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.382879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.383637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:02.383947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.385334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.398111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 293/594] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:02.398957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.469392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6d840-0d73-4f46-95b1-662eeb223dd8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.500335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97261569-59a2-499c-aaf2-339304d045fb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.503931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.505826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.506311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.506777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.513848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.515591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.529525 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:02.531313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 302/595] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:02.532459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.535312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.536434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.536766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.536981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.544399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.545862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.560890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 29 15:45:02.562169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 294/596] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:02.567027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.638801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985988e-53b4-4565-a995-0fb9298e69dc None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.660413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab3e0ad-0258-4079-a896-1e21a766be72 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.675021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.676297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.676800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.677456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.686587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.688456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.703068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:02.704212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.704905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.705147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.705456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.705670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 303/597] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:02.706202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:02.706508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.707103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.708050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.720820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 295/598] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:02.721715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.808830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8566-490b-4e83-8acb-86ce1741e6b0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.821748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed439531-e143-46df-a590-fbbbb0936107 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.844283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.845290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.845771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.846233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.847245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:02.847793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.849948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.856028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:02.856687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:02.856990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:02.857295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:02.858077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:02.858389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:02.859845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:02.874040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 296/600] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:02.874040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.874595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 304/600] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:02.875730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:02.971549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0f363-0c82-4230-a8d8-d4b475791a96 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:02.974603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f3373-5deb-486c-a05e-d42acfd5ccc6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.005144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.006115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.006495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.006776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/6b029906da704309ad9b8da03b51c054/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.009957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.011019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.011506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.012022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.023060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=6b029906da704309ad9b8da03b51c054, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.024235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.024590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.026163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.040790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 297/601] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:02 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/6b029906da704309ad9b8da03b51c054/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:03.041787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.046550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:03.048582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 305/602] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:03.054533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.161745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4bb4-fdd2-4095-a979-5e0e7ec5f192 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.162044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f3223-d272-4dcb-8015-742413c6b870 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.198521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.198770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.199445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.199762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.200042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/f956c2a9dfbd40fbabd043c371e579e7/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.200396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.200969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.201604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.202539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:03.203039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.204716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.217860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 306/603] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:03.221018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=f956c2a9dfbd40fbabd043c371e579e7, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.222727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.235445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.264244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 298/604] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:03 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/f956c2a9dfbd40fbabd043c371e579e7/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:03.357494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c74b1-5a07-4c5f-a046-06887513b1fb None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.399753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.400579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.400863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.401190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.409044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.410589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.425872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-c1c453d0-9629-41a8-8315-5dbe0613bb50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:03.427404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 307/605] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:03.432966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.453849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f9bd-8712-40b1-9d6f-44d6ad3a290d None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.454453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f9bd-8712-40b1-9d6f-44d6ad3a290d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.454936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91f9bd-8712-40b1-9d6f-44d6ad3a290d None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.457191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 308/606] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:03.463228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.463853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.464357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.482394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:03.483983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:03.562389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b1d7-ce61-4fb6-aca0-4c00290a8b0b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.562912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 309/607] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:45:03.590206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.605397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.606404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.606902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.607383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.608378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:03.608880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.610543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.623336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 299/608] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:03.629274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.740864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa0ca-32d3-4e3b-9cd1-5befea19fb30 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.746704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cef8b-1056-41b4-93cb-27777e0d980c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:03.778375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.779267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.780702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.780927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/aa8ff0744fac48fd8dca772e998701ef/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.805493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=aa8ff0744fac48fd8dca772e998701ef, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:03.806945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:03.814156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:03.814954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:03.815235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:03.815511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:03.828665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 300/609] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:03 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/aa8ff0744fac48fd8dca772e998701ef/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:03.831361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:03.839493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:03.841158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 310/610] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:03.853030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:03.983302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fbfd4-4e68-41f8-8dbe-3ff8f690d14f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:04.025528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:04.026124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.026412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.026690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.027437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:04.027846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:04.029221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:04.046290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 301/611] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:04.051502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:04.157213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ecc25-a8c7-48b6-8a7e-3e50503e92c0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:04.193317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:04.194485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.194985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.195469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.206557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:04.208412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:04.225981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:04.227848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 311/612] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:04.235121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:04.355862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeabe41-68d9-473f-9606-51782f29ef48 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:04.394929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:04.396190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.396481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.396763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.397492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:04.397802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:04.399185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:04.415829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 302/613] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:04.417007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:04.602697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98813df9-735d-4e4f-985d-48f957615dc6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:04.657220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:04.657941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.658222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.658494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.668080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:04.669699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:04.686986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-5ec2f1fd-04c4-4753-914f-6ed7481b730e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 15:45:04.688499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 312/614] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:04.694074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:04.849692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35708e93-a3fa-4968-ac27-76b95baa7433 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:04.876189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4a69-02eb-4751-b159-3b7a7459dfee None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.876489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4a69-02eb-4751-b159-3b7a7459dfee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.876742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac4a69-02eb-4751-b159-3b7a7459dfee None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.878752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 313/615] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:04.884078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.884359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.884631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.907539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:04.908628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:04.922966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:04.923666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:04.923951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:04.924223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:04.925052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:04.925357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:04.926788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:04.961225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 303/616] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Mar 29 15:45:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:04.963285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.020989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 314/617] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:45:05.056568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.094886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34a840-f9f2-4e32-b77a-85fcbcfd5eaf None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.134932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.135764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.136045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.136319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.148217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.149655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.167683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:05.169546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 304/618] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:05.175185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.241020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2dd1-f2cd-4828-89f7-8cf5020d1e78 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.287033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.287862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.288143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.288418 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.308623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:05.309960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1ab24-751f-47a2-837d-7b74b35448a3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.323915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:05.325482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 315/619] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:05.330997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.360316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.360960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.361252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.361569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.362267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:05.362581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.364151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.380905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 305/620] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:05.387620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.440584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dc2aa-db40-4241-8c66-dc45dcf8dc9d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.488134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.488834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.489119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.489468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.490251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:05.490559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.492023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.493501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b0500-5832-47ef-b36f-a423a5598a6f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.507938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 316/621] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:05.513222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.534615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.535592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.535971 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.537010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.552653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.554379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.587558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:05.589504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 306/622] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:05.594596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.621424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9858199-4f99-4cd5-bd87-ff5fada9d1c7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.667332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.668471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.671123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.671628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.697911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.699586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.729894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:05.736833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 317/623] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:05.739497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.806077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37319cda-9e18-40e2-90ac-28cbfb423604 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.876825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.877840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.878350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.878820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.879927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:05.880493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.882144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.903588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 307/624] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:05.910200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:05.933045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7d251-2eba-4259-b37c-617c3b169817 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:05.967229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:05.968280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:05.968777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:05.969244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:05.970176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:05.970685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:05.972290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:05.984925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 318/625] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:05.991122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.046516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be9c2d-c7b2-40a9-9d4f-23666906f8be None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.085404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063213-d1ac-438b-a674-eb07b598adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.086294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063213-d1ac-438b-a674-eb07b598adde None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.086580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063213-d1ac-438b-a674-eb07b598adde None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.086853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063213-d1ac-438b-a674-eb07b598adde None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/7152e01448494ebd98eb204c3e602a77/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.106529 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063213-d1ac-438b-a674-eb07b598adde None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=7152e01448494ebd98eb204c3e602a77, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:06.108019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063213-d1ac-438b-a674-eb07b598adde None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:06.124239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 308/626] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:05 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/7152e01448494ebd98eb204c3e602a77/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:06.126382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320400-0c12-42ca-84e2-7f65267404b3 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.127188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320400-0c12-42ca-84e2-7f65267404b3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.127822 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9320400-0c12-42ca-84e2-7f65267404b3 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.135023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 309/627] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:06.136313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacfa8-98f9-4c45-8be6-d8aec3d0ea90 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.136595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacfa8-98f9-4c45-8be6-d8aec3d0ea90 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.137163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bacfa8-98f9-4c45-8be6-d8aec3d0ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.155192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-37bacfa8-98f9-4c45-8be6-d8aec3d0ea90 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:06.156821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-37bacfa8-98f9-4c45-8be6-d8aec3d0ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:06.157137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce28da-39a9-462b-93e9-9b25c0f79583 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.211494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.212846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.213130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.214379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.230146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:06.232221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:06.243847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 310/628] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:45:06.245824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfafaa6-61ae-4993-837d-e1a1d7d8653e None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.246351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfafaa6-61ae-4993-837d-e1a1d7d8653e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.246860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfafaa6-61ae-4993-837d-e1a1d7d8653e None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.249303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 311/629] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:06.258962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:45:06.261098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.261595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.262087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.268745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 319/630] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:45:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:06.275519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.286056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:06.287863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:06.372991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 312/631] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:45:06.374392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.409293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7acec-649b-4a07-814b-f06c5f633ee9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.453855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.454829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.455296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.455802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.456816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:06.457304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:06.459455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:06.484396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0998-130a-42ba-878e-fc34f44fcc18 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.487309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 320/632] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:06.488415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.520913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.521828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.522162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.522515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.533204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:06.541155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:06.542784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 313/633] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:06.543851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.617383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9066-a2f4-4a24-966c-072b3c6a0c2c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.644124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd6f28-304d-4abd-8d97-a0640245e066 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.668096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.668930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.669207 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.669477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.680913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:06.686393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39405da4-511a-4e56-86d0-a3c73d6a6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.687351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39405da4-511a-4e56-86d0-a3c73d6a6749 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.687890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:06.688274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39405da4-511a-4e56-86d0-a3c73d6a6749 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.688772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39405da4-511a-4e56-86d0-a3c73d6a6749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.689429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 321/634] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:06.690341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.771747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39405da4-511a-4e56-86d0-a3c73d6a6749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:06.773357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39405da4-511a-4e56-86d0-a3c73d6a6749 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:06.800299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857f201-3f90-4d75-9d2f-dec7cad48f64 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.831666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.832333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.832617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.833417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.834168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:06.834476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:06.835886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:06.843745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 322/635] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:06.844530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.878094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 314/636] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:06.879506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d276-961a-40c4-b136-57d5d2234f13 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.879865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d276-961a-40c4-b136-57d5d2234f13 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.880146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d276-961a-40c4-b136-57d5d2234f13 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.886085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 315/637] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:06.886085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d276-961a-40c4-b136-57d5d2234f13 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:06.945735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d25b14-17d8-443a-8138-90dbbc488a88 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.980117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:06.980780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:06.981062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:06.981344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:06.982089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:06.982393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:06.983794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:06.984508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d276-961a-40c4-b136-57d5d2234f13 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:06.991643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 323/638] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:06.992450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.021567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.023440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.023440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.023440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.033278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.034725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.051122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-5844bf75-4151-4e8d-858d-cc10b10deb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:07.052610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 316/639] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.054347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.054768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.055159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.072552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:07.073726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:07.106310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c2e92-36c3-4e83-ba59-637bb059ceb6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.139965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 317/640] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:07.141029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.152786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.153970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.154356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.154736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.167508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.169024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.184913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:07.186265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 324/641] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.188413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.240290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6ada-de75-421a-a929-623df87593a9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.274281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.274999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.275288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.275601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.286309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.288761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.290112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9dd4f-0739-416c-af2a-bdb8119ac4f0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.309286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:07.311489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 318/642] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.313222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.322775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.323437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.323755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.324377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.324757 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:07.325066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.326438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.342568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 325/643] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:07.342568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.422430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c83b2d-b212-4889-9619-1589b185b1ae None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.451394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29c161-7489-49ec-8ba3-d57f114bd444 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.455048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.455876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.456165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.456444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.467404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:07.474906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:07.480714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 319/644] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.480714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.485525 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.486191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.486480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.486759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.487481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:07.487820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.489238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.500044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 326/645] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:07.500836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.580344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f273-f72a-43b8-92f1-b1eb49f49a78 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.593703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d4bbe-ac45-4ab4-a9a1-23e80e39e70b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.612260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.612915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.613222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.613648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.614904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:07.615212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.616629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.625614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.626399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.626681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.626957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.632686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 320/646] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:07.632686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.634463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.635938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.649577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 29 15:45:07.655112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 327/647] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.655112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.731500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4a87-3c58-4fc9-b85a-02a14e580ed2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.749892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50feff4-b3fe-4548-8450-6325f631d6a8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.773023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.773700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.773986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.774265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.775013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:07.775321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.776762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.784291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.789698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 321/648] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:07.789820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.789820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.789973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.790045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.798511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.798511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.812334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:07.813714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 328/649] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.814292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.890716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a985d-2429-4798-bf41-c2e00af9405c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.912156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3048d-b8e7-4322-a712-da21572fc68f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:07.923231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.924137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.924423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.924699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.932052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.933521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.946756 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:07.947553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:07.947956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:07.948334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:07.948912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 15:45:07.949379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:07.949792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:07.954779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 322/650] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:07.954779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:07.955005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:07.969072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 329/651] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:07.969992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.058625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd27a7-dfcf-426d-9bb8-5e1976a4e331 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.077601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc828a-1409-4156-b059-c7def2d09cf0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.092792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.093708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.094062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.094406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.105341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.106931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.118383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.119045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.119328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.119633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.120426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:08.120737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.122175 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.127206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:08.128503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 323/652] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:08.129330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.137399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 330/653] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:08.138495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.233120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd24442-b026-4c3b-b4d8-f517bf1464d1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.238070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d346e-2fcf-48de-bdd8-a3f6e6ec957e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.265447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.266111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.266394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.266672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.267508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:08.267848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.269287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.271459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.272138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.272417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.272695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.287977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 324/654] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:08.288805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.342326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.343826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.384009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48f455-9252-4a39-a58b-cd748e5cb0a3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.421359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.422021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.422310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.422586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.423307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:08.423637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.425011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.436698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 325/655] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:08.437836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.442894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 331/656] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:08.443931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.538496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8e56-eb03-499c-b5a6-56d69995b547 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.544138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697742-6a42-4c1d-ae0e-3dd49026038d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.570452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.571104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.571587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.571878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.572704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=ba546b8ade2443a096e7f303d609b622) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:08.573015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.574438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.577250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2e45c-878e-40ba-b274-32e26b8985b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.577896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e45c-878e-40ba-b274-32e26b8985b6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.578180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e45c-878e-40ba-b274-32e26b8985b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.578458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2e45c-878e-40ba-b274-32e26b8985b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.580166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 326/657] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/role_assignments?user.id=ba546b8ade2443a096e7f303d609b622&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:08.580998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.650051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2e45c-878e-40ba-b274-32e26b8985b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.651569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2e45c-878e-40ba-b274-32e26b8985b6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.682190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3c35d-0cfb-4fa1-98a6-82716167052c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.716604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.717475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.717762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.718037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.726842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.728377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.742846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 29 15:45:08.749273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 327/658] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:08.750515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.758996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 332/659] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:08.761343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14463ed4-5923-44ca-a536-8e133b9176fd None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.761854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14463ed4-5923-44ca-a536-8e133b9176fd None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.762333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14463ed4-5923-44ca-a536-8e133b9176fd None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.764810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 333/660] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:08.765571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14463ed4-5923-44ca-a536-8e133b9176fd None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.852349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee69077-6e8e-483d-9bde-968afcd0d212 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.866750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14463ed4-5923-44ca-a536-8e133b9176fd None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:08.884037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.884826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.885111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.885388 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.896042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.897503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.901109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:08.902010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.902512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.902986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.904074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:08.904587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:08.906235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764233c-7975-4987-86da-18ca564eb7b6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:08.913477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:08.914678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 328/661] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:08.915550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:08.934004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 334/662] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:08.934004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:08.934004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:08.934004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:08.948744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:08.949942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:09.016003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05c34-b5bd-4ec2-adbe-f927cae4130b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.023829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 335/663] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:09.031555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.058937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.059928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.060221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.060498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.070932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.072433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.089085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:09.094631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 329/664] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:09.094631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.127567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc99397-73a8-4293-a7f7-3b00784384fd None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.161077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.161798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.162083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.162380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.163098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:09.163404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.164804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.175686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 336/665] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:09.177188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.192072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3819-d9c9-4499-9a9a-809735acce23 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.229146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.229789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.230077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.230349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.272465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30bca-a877-43bf-a91c-0c78a0c05af2 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.294773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.296259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.304735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.305533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.305820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.306096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.315899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:09.323360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:09.324738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 337/666] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:09.325419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.395824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 330/667] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:09.396984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.427671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619714d-843e-47a8-a38c-7f1a5e68b5cf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.461026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.461702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.461989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.462522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.463245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:09.463574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.465473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.478476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 338/668] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:09.479312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.495470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0cecc-5e51-483e-93d6-559d8bd2ec2b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.527412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.528222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.528507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.528782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.535449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.537216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.549887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:09.556275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 331/669] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:09.556275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.577333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cc14b-553e-4746-bb1a-50735141c89a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.611550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.612515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.612801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.613080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.613853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:09.614694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.616277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.624116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 339/670] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:09.624912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.652765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab196fc-332a-4982-899a-36d0c1ae5225 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.685666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.686464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.686750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.687031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.698319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.699800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.716734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:09.718090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 332/671] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:09.718700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.729639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee13f4f-28ad-4d4b-b2cf-087a59ec1ca9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.767041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.767905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.768244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.768530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.776494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.777966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.792142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:09.798272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 340/672] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:09.798272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.818212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b44c-d814-4f6d-8902-9a0ef71d9ef5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.851743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.852401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.852686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.852964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.853741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:09.854051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.855508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.872125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 333/673] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:09.873270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.890760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5603a-e8a9-4d63-aa64-baf99a84b533 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:09.924890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:09.925608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:09.925890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:09.926163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:09.936709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:09.938634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:09.955480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:09.961575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 341/674] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:09.961575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:09.972635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448fa85-e014-4d49-a6b0-e7ce7766076b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.008101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.008759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.009042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.009316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.010086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.010393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.011763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.023183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 334/675] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.023886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.060895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40231dc9-0e2a-4327-ad31-9bf073b48cc9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.094144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.094803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.095088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.095364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.096178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.096488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.097920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.114924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 342/676] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.114924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.122900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4da63d-16fa-4f31-b50d-68664846b00c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.155730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.156382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.156669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.156944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.157765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=6b029906da704309ad9b8da03b51c054) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.158079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.159503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.165618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 335/677] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/role_assignments?user.id=6b029906da704309ad9b8da03b51c054&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.166397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.220797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6e2fb-4ebd-4550-994a-048e7a1edc52 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.267772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.268841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.269331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.269817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.271462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.272027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.273657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.291493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 343/678] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.292782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.295482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14503b-3a4c-4896-a41e-1b93ab69bbb3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.331484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.332205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.332491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.332838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.341418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.342896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.358677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:10.364508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 336/679] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:10.365623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.416762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dac49-b220-4729-83cf-937fb6197095 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.453392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.453973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.454259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.454538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.455375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=f956c2a9dfbd40fbabd043c371e579e7) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.456612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.458659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.465675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 344/680] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/role_assignments?user.id=f956c2a9dfbd40fbabd043c371e579e7&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.466294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.474906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8899b-c481-4266-8e9b-5d54b486398e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.515091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.515936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.516222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.516500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.525348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.526880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.543618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 15:45:10.545218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 337/681] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:10.556639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.578610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a16aa-c107-4bb3-be3e-ee38704da42a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.617818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.618608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.618918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.619200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.620049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.620364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.621884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.635062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 345/682] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.640858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.667838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e02d9-f423-4fca-88b8-29ded5d1b28b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.713833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.714519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.714803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.715080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.715951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.716260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.717800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.736153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 338/683] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:10.741659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:10.744574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af1856-667d-4aaf-b064-9dd8e103d587 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.784130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.785546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.786541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.786965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:10.787967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=aa8ff0744fac48fd8dca772e998701ef) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:10.788429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:10.790026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb465301-1b4b-4412-89f6-6f7e1981454a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:10.797195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 346/684] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/role_assignments?user.id=aa8ff0744fac48fd8dca772e998701ef&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:10.871098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e83c37-04f5-4f9f-90cf-e6b2a2cb2f11 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:10.921958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:10.922624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:10.922911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:10.923190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.007708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:11.009158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:11.061439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683213ad-069b-48fc-a1ae-0c2ba0ffa0cc None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.062256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683213ad-069b-48fc-a1ae-0c2ba0ffa0cc None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.062630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683213ad-069b-48fc-a1ae-0c2ba0ffa0cc None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.068829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 347/685] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:11.071135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.071504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.072282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.094805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:11.096022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:11.121917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 339/686] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:11.131562 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:11.175407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 348/687] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:11.202617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:11.234352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0c43d-0004-4efc-91ce-aadd07f24a1f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:11.269688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:11.271325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.271841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.272338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.282696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:11.284443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:11.302439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:11.303646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20dd6-2e0c-4353-9814-717ea64f4974 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:11.304599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 340/688] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:11.315914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:11.362389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:11.363255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.363559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.364420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.382735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:11.400297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:11.401724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 349/689] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:11.408387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:11.503899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669f368-d880-4890-abfc-42ab7ffc1833 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:11.541638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:11.542226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.542507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.542777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.543502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:11.543829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:11.545969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:11.568025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 341/690] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:11.574925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:11.619356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa12ac-b7e8-44d0-9603-c771e69390dc None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:11.727980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:11.728658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.728944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.729222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.729978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:11.730286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:11.731967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:11.733613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467b345-25e0-4422-ab87-5d389333f09a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:11.757851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 350/691] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:11.772813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:11.811795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:11.818193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:11.818484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:11.818764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:11.834986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:11.841306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:11.877192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:11.878439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 342/692] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:11.884917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:12.037562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d52c9-788c-4f6b-b4c6-7ab4adeeea75 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:12.135649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897ffdb-7045-4e9d-b30d-41d64148f7fc None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:12.194498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:12.195326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:12.199556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:12.199556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:12.223325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:12.226906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:12.236192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:12.237168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:12.237658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:12.238152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:12.239197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:12.240733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:12.242402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:12.281017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:12.282607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 351/693] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 510 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:12.288252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:12.289868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 343/694] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:12.298995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:12.462686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7e776-b9c2-4a3b-b2ff-ccdfcc4d65c8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:12.492542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07cd12-ce04-45a3-ae8c-9a886b682485 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:12.534925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:12.536138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:12.536434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:12.536709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:12.537441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:12.537743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:12.539211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:12.563233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 352/695] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:12.563756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:12.564462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:12.564749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:12.565023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:12.565928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=7152e01448494ebd98eb204c3e602a77) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:12.566243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:12.568240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:12.570958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:12.583443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 344/696] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:12 2022] GET /identity/v3/role_assignments?user.id=7152e01448494ebd98eb204c3e602a77&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:12.704302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5d380-d300-41e7-98fe-50b6f0e5c399 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:12.753249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:12.754503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:12.754997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:12.755504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:12.768564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:12.770635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:12.790340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:45:12.791878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 353/697] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:45:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:12.798478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:12.931332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbedc11-3058-486e-8c43-3dfba8e2d136 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:12.974728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:12.975412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:12.975732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:12.976012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:12.976861 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:12.977174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:12.978604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9368e-2367-4f17-9ade-0949a8bc48d2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.002467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 345/698] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:45:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:13.008842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.088619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498785-0b9c-4e3a-8760-82536f611b54 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.088960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498785-0b9c-4e3a-8760-82536f611b54 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.089184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b498785-0b9c-4e3a-8760-82536f611b54 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.091241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 346/699] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:13.096407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.096703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.096984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.123443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:13.124671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:13.143473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3298bf-2c7d-45e3-b061-25b06133831d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.205876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb61f35-f754-4370-99a1-735b8735fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.206537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61f35-f754-4370-99a1-735b8735fa9a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.206823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61f35-f754-4370-99a1-735b8735fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.207097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb61f35-f754-4370-99a1-735b8735fa9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.245323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 347/700] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:45:13.303008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61f35-f754-4370-99a1-735b8735fa9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.304463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb61f35-f754-4370-99a1-735b8735fa9a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.309630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.472510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 354/701] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:13.474324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d62f1-6870-4635-b504-149582037977 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.474831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d62f1-6870-4635-b504-149582037977 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.475311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d62f1-6870-4635-b504-149582037977 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.481344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 355/702] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:13.482315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d62f1-6870-4635-b504-149582037977 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.482970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5efcef-40a0-4739-9cee-53fe237915ce None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.524924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.526126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.526418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.526698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.539798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.541990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.565117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-3b0b8f72-7315-45e5-a882-45e014090268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:13.571415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 348/703] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:13.571415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.571415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.571415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.592020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:13.593210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:13.594406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d62f1-6870-4635-b504-149582037977 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.629097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.630425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.631024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.631611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.643127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.645449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.662969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:13.667771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 356/704] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:13.669185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.678583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 349/705] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:13.679501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.782995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbdcf5-7bba-40e2-b0c1-51f2ecfb816f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.785353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676803-da11-4f57-8805-7cbf2e90eb1a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.816033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.816621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.817431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.817540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.817712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.818120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.818399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.818491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:13.818669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.818762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.819381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:13.819707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.820241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467ed0-8afb-4ca9-9a7b-71196de77e8a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.821051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.835825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 357/706] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:13.835992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 350/707] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:13.835992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.837277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08363d-cb35-4cb4-af29-9d8fa33fe263 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.837575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08363d-cb35-4cb4-af29-9d8fa33fe263 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.837861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08363d-cb35-4cb4-af29-9d8fa33fe263 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.839622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 358/708] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:13.840354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08363d-cb35-4cb4-af29-9d8fa33fe263 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.934447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5194dd2-3c9f-43ad-b205-b075517d50df None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.939118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08363d-cb35-4cb4-af29-9d8fa33fe263 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:13.968187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.969042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.969272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.969544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.970186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.971487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155bd22-b3bc-4d79-835b-d40114186ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:13.971632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.972182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bd22-b3bc-4d79-835b-d40114186ddf None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.972470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bd22-b3bc-4d79-835b-d40114186ddf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.972752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bd22-b3bc-4d79-835b-d40114186ddf None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:13.973993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155bd22-b3bc-4d79-835b-d40114186ddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:13.975447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155bd22-b3bc-4d79-835b-d40114186ddf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:13.984876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 29 15:45:13.986113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 351/709] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:13.986986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:13.995606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 359/710] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:45:13 2022] POST /identity/v3/users => generated 254 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:13.997122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:13.997581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:13.998064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.018733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:14.020113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:14.104054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 360/711] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:14.105435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.130968 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806fa5c-e601-4c93-a849-7e724c79ed05 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.167786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.168569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.168857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.169134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.177217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.179313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.193552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:14.194897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 352/712] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:14.200221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.232808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb095-2f8e-4306-8edd-c69f4d9549cf None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.276831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.277782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.278247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.278691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.279612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:14.280090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.281634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.286152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 361/713] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:14.287109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.314836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f63160-d211-4cd3-9089-6047546882ce None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.362312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.363036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.363321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.364155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] PATH_INFO: `/v3/services/network` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.364820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.366210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.380473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 29 15:45:14.382277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 353/714] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:14.383073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.393367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fd971-2458-4254-8e47-3a83ac7ae29b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.431549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.432611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.433112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.433604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.434621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:14.435126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.436799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.449438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 362/715] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:14.450637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.499287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a247-00ef-477f-9d74-6fd3ec8c5cda None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.542495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.544139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.544754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.545255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.546342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:14.547138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.548888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.555228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5961fd-5017-4339-9859-9e636f0a689d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.555512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 354/716] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:14.556644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.603144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.606383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.608215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.609582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.612412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] RBAC: Adding query filter params (name=network) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:14.613023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.615695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.626776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 363/717] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:14.631255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:14.717426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd38b74-cd13-4b11-a8ec-b00d1be03140 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.763053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.765406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.765921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.766397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.767445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=ba546b8ade2443a096e7f303d609b622) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:14.768151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.770275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa9e5-ceb2-466b-a585-c5ee3d236e35 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.777208 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 355/718] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/role_assignments?user.id=ba546b8ade2443a096e7f303d609b622&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:14.822462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c04ce9-eb81-4de3-bdd5-3869990e52c1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:14.863182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:14.863893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:14.864182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:14.864461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:14.865197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] RBAC: Adding query filter params (type=network) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:14.865507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:14.866938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dacd1c-ceee-4511-b7ee-9ce8a64d698e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:14.874003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 364/719] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:15.275270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b02e1-85ba-4463-82e5-aa4856754ebb None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:15.275670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b02e1-85ba-4463-82e5-aa4856754ebb None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:15.275872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b02e1-85ba-4463-82e5-aa4856754ebb None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:15.277943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 356/720] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:15.283178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:15.283655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:15.283828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:15.301630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:15.302817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:15.375689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 365/721] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:15.394229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b02e1-85ba-4463-82e5-aa4856754ebb None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:15.497132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b02e1-85ba-4463-82e5-aa4856754ebb None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:15.531028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:15.531786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:15.532071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:15.532352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:15.543889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:15.550861 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:15.556971 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 357/722] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:15.558428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:15.670138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63377ff0-b732-4219-84f6-0ed05a3ba102 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:15.704625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:15.705651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:15.706145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:15.706620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:15.708235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:15.708745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:15.710340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:15.719977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 366/723] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:15.725287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:15.846376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a388f-a3d3-4eff-8c6a-64180111e3d3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:15.881124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:15.882022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:15.882307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:15.882582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:15.892886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:15.894340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:15.912276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:15.913324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 358/724] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:15.919187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:16.053379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024f21e-2df9-428d-a05e-ce13a1287254 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:16.089617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:16.090300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:16.090587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:16.090870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:16.092454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:16.092454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:16.093867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:16.106842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 367/725] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:16.112406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:16.270458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc384fe-22e2-4b2d-9551-a0094cb80206 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:16.308288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:16.309537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:16.310048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:16.310615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:16.318516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:16.320207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:16.334722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 15:45:16.340952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 359/726] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:16.342511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:16.461021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a928b-0ff5-4622-abf5-4eeea0add5f0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:16.495078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:16.495781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:16.496069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:16.496350 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:16.497189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:16.497504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:16.498936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:16.516319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 368/727] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Mar 29 15:45:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:16.524746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:16.689389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620c24-d7cc-4972-a97d-e24cbf170ec9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:16.723399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf31dc-3b28-4784-b86d-c24fdc49940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:16.724461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf31dc-3b28-4784-b86d-c24fdc49940d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:16.724943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf31dc-3b28-4784-b86d-c24fdc49940d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:16.725443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf31dc-3b28-4784-b86d-c24fdc49940d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:16.796641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf31dc-3b28-4784-b86d-c24fdc49940d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:16.798431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf31dc-3b28-4784-b86d-c24fdc49940d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:16.930145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 360/728] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 29 15:45:16.931909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.056229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97890e-6e03-406f-8646-5215306ebe76 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.095188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.096409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.096892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.097388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.118347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:17.120286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:17.121144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f8e2-2e8a-4354-a808-2444065b8758 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.121668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f8e2-2e8a-4354-a808-2444065b8758 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.122169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f8e2-2e8a-4354-a808-2444065b8758 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.124446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 361/729] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:17.136834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.137441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.137909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.143042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:17.149473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 369/730] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:17.150872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.169384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:17.170947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:17.264605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc94c3d-4e61-48cc-b123-46f808aa0b62 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.311270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.312377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.312855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.313323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.314267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:17.314764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:17.316420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:17.317258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 362/731] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 29 15:45:17.339794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 370/732] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:17.341071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.345467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.462657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1ca2d-cb29-4df1-be40-574c9d3db396 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.510128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856146cd-cecc-47c0-9521-ec4b61a614c9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.525032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac709a1-a198-4363-8177-f794be5495b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.526577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac709a1-a198-4363-8177-f794be5495b6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.527077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac709a1-a198-4363-8177-f794be5495b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.527571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac709a1-a198-4363-8177-f794be5495b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.543330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac709a1-a198-4363-8177-f794be5495b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:17.550942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-1ac709a1-a198-4363-8177-f794be5495b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:17.555660 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 363/733] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:17.557486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8baf-b87b-4d67-9be4-d2ed61a54756 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.558022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8baf-b87b-4d67-9be4-d2ed61a54756 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.558496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a8baf-b87b-4d67-9be4-d2ed61a54756 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.558781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.559609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.559993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.560275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.564515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 364/734] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:17.565614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8baf-b87b-4d67-9be4-d2ed61a54756 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.573336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:17.574803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:17.594295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f21d230e-d27f-4aa0-bde6-3908a712ff0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:17.599557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 371/735] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:17.599557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.599557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.599557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.618237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:17.619706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:17.677580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a8baf-b87b-4d67-9be4-d2ed61a54756 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.698522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 372/736] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:17.699395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.726757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.727779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.728280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.728740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.729687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:17.730167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:17.731750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a0327-3ec3-4659-b699-ba5f0c76bddb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:17.739860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 365/737] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:17.741419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e237-b2d1-4e1d-b44d-153085bd25ef None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.741908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e237-b2d1-4e1d-b44d-153085bd25ef None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.742359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e237-b2d1-4e1d-b44d-153085bd25ef None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.745252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 366/738] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:17.746186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e237-b2d1-4e1d-b44d-153085bd25ef None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.804867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a1bf-6667-448b-95a2-f58022fefba5 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.837324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.837901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.838181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.838456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.839230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:17.839558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:17.840977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:17.847615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e237-b2d1-4e1d-b44d-153085bd25ef None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.852474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 373/739] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:17.857431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.883906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266f80-1fab-48fa-908f-4223c767b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.884702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266f80-1fab-48fa-908f-4223c767b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.884989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266f80-1fab-48fa-908f-4223c767b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.885267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266f80-1fab-48fa-908f-4223c767b7d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.896393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2266f80-1fab-48fa-908f-4223c767b7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:17.903308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-e2266f80-1fab-48fa-908f-4223c767b7d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:17.904547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 367/740] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:17.905718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.906006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.906283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.923296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:17.924527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:17.951513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7c12e-b20e-40d9-92f0-43afdc265823 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:17.982211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:17.982997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:17.983279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:17.983589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:17.986595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 368/741] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:17.988880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:17.994302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:17.995780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.012122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-da202e17-9a16-4673-807c-c441f77bcf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:18.013316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 374/742] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:18.014555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670928c-94d6-435d-9158-499acee1fe08 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.014841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670928c-94d6-435d-9158-499acee1fe08 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.015118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670928c-94d6-435d-9158-499acee1fe08 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.016915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 375/743] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:18.017663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670928c-94d6-435d-9158-499acee1fe08 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.081785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3a61a-6c94-4958-81f9-a39502ff99e2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.113276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670928c-94d6-435d-9158-499acee1fe08 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.115858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.116512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.116795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.117071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.117898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=7152e01448494ebd98eb204c3e602a77) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:18.118214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.119659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.125015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 369/744] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:17 2022] GET /identity/v3/role_assignments?user.id=7152e01448494ebd98eb204c3e602a77&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:18.125623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.147721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.148419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.148708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.148990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.149794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:18.150115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.151551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.166002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 376/745] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:18.166002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.236842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d51f45-254b-4960-9c9d-359996b41b25 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.275395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e823a-849e-498a-863d-b634ca943252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.276102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e823a-849e-498a-863d-b634ca943252 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.276272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f0079-911d-4e94-9e22-0e0b961c5028 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.276373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e823a-849e-498a-863d-b634ca943252 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.276655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e823a-849e-498a-863d-b634ca943252 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.277386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e823a-849e-498a-863d-b634ca943252 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.279129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e823a-849e-498a-863d-b634ca943252 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.295047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 370/746] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:18 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:18.296768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.297277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.297802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.318420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:18.320838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:18.336349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.337342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.337627 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.337905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.338656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:18.338967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.340457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.353047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 377/747] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:18.354100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.424264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 371/748] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 29 15:45:18.425602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.462258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13f70-a28f-416d-a43a-046651507f3a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.498395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.499184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.499469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.499791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.512244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.513741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.530482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:18.532070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 378/749] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:18.532842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.537425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4b4b-b476-43b8-8c26-e59def175c24 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.581648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.582939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.583435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.583937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.594500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.596268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.611739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 15:45:18.613267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 372/750] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:18.618585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.650349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98794673-6ca2-4154-889a-eb6af811f5b3 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.693913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.694501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.695262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.695564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.696732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.698287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.719086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 379/751] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:18 2022] POST /identity/v3/services => generated 240 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:18.720007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.736186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4f4b-b50c-4fad-a1be-bad25b9f4a52 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.799013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.808415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.809138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.809635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.810617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:18.811203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.812966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.837100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 373/752] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:18.842951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.849528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714ceb9-50fa-4837-b173-8c0556672396 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:18.892638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:18.893338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:18.893625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:18.893903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:18.895303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:18.895644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:18.898672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:18.919826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 380/753] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:18.932846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:18.995540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139001c-f591-462d-8409-3f5d76721c31 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.035094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.036461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.036744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.037023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.044979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.046435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.049981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5398c85-19fe-4f04-bf3b-f9909d17f38b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.060837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:45:19.063024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 374/754] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:19.070511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.092288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.092944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.093228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.093508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.161676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.163172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.183077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73f598-d649-4a21-8759-0c2156ddd67b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.229353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.230091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.230381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.230659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.231506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:19.231972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.233434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.262928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 381/755] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:45:19.267863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.273362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 375/756] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:19.278968 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.387717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c292db-f666-44a8-8ea4-bd7e618f8078 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.460184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357cb1f-b1ed-453e-98ee-bf2660f49298 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.464588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.465620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.466112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.466578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.481565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.483325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.513915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:19.523352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 376/757] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:19.531547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.531547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.531547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.531547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.533115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.541762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.544092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.562732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:19.564643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 382/758] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:19.570133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.711182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537e6b-8cd8-42fb-b7ba-3376afc5b9e7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.749080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d93567-bec4-4674-94bc-5db457ac14f7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.757584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.758263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.758546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.758827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.759582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:19.759894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.761271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.785633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 377/759] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:19.788377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.820271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:19.820986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:19.821297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:19.821551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:19.822336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:19.822645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:19.824053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:19.840971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 383/760] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:19.848180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:19.962348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b3dea-6482-48b4-a444-e706242a124d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:19.976764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0a2b7-e2f5-4a40-a87e-77af8a5c1750 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:20.024239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:20.024955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.025235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.025511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.034510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:20.036504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:20.037487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:20.038282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.038560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.038829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.050638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:20.052178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:20.060106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:20.061310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 384/761] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:20.075082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:20.076309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 378/762] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:20.077130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:20.084543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:20.190308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5893271-245e-4103-b958-8d2cb49f4c4b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:20.232793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:20.233464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.233750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.234032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.234829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:20.235137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:20.236631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:20.260439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 379/763] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:20.266234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:20.277040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de9c58-5ace-46bf-9f71-77ddfd6f6af9 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:20.311128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:20.311826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.312113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.312392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.313245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:20.313560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:20.315204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:20.327423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 385/764] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:20.333662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:20.456173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c8c79-3151-4290-8841-6fe982daff4a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:20.487065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb9ac-31ac-45ea-bbf8-a859e6c248f8 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:20.493208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:20.493875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.494158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.494434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.495264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=982d0437047a4e6bb92851c916d6d4d8) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:20.495595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:20.497045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f81bb4-3631-42fe-bd22-d14a7bd1a259 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:20.507655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 386/765] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:20 2022] GET /identity/v3/role_assignments?user.id=982d0437047a4e6bb92851c916d6d4d8&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:20.551179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77462-f138-465f-8ee4-dfad363cdd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:20.552031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77462-f138-465f-8ee4-dfad363cdd3d None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.552313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77462-f138-465f-8ee4-dfad363cdd3d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.552592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77462-f138-465f-8ee4-dfad363cdd3d None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/ba546b8ade2443a096e7f303d609b622/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.561338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b77462-f138-465f-8ee4-dfad363cdd3d None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=ba546b8ade2443a096e7f303d609b622, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:20.562909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b77462-f138-465f-8ee4-dfad363cdd3d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:20.586027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 380/766] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:20 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/ba546b8ade2443a096e7f303d609b622/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:45:20.827983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94805b8d-91f2-4402-9675-5b2f6eaecfe5 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.828595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94805b8d-91f2-4402-9675-5b2f6eaecfe5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.829088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94805b8d-91f2-4402-9675-5b2f6eaecfe5 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.831323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 387/767] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:20.837580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.838042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.838117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.859114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:20.860388 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:20.931691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 381/768] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:20.954433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38c63-5c8a-4e21-960c-cfcc036e3354 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.954619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:20.954730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38c63-5c8a-4e21-960c-cfcc036e3354 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.954981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38c63-5c8a-4e21-960c-cfcc036e3354 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.957529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 388/769] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:20.963125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:20.963715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:20.964213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:20.996564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:20.998098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:21.062565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67783a2e-cd88-4b2b-a876-01a6508195f6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.101405 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.102446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.102880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.104086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.123439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:21.131740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:21.139059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 382/770] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:21.140723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 389/771] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:21.148540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.163656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.288881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121ccd-a230-4754-b285-3bf2ad8ec7b6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.325865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31feac-4ff9-40eb-9d49-988dfb0a06f4 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.336233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.337320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.337599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.337876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.338541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.339944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:21.359874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 29 15:45:21.361468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 383/772] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:21.365316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.367328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.370250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.371652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.372081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.374569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:21.375106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.377052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:21.395729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 390/773] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:21.401395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.565587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708631b-2922-45e3-a3ec-a5993f8e8397 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.582512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654255-2104-40de-baf7-ce3d6b330d3e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.619364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.620740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.621704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.622526 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.622972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.623398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.623835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.624413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.625807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:21.626446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.629230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:21.642926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 384/774] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:21.644197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.646453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:21.656526 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.664767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:21.666439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 391/775] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:21.677642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.776903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f30af-3a7a-4593-a090-b63c368900df None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.797823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d32ce-3e27-412d-8adf-b698bd0744e2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.816377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.817554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.818007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.818444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.819314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:21.820224 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.822204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261690a-e3aa-4127-9865-16dcc1736d96 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:21.835867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.836962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.837250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.837526 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.838267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:21.838822 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.844338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 392/776] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:21.844525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56137e1c-333f-42bb-a91c-3d8abaeabf28 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:21.845260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd09ae-8337-459d-a34e-966217faf5be None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.845551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd09ae-8337-459d-a34e-966217faf5be None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.845827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd09ae-8337-459d-a34e-966217faf5be None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.848493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 393/777] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:21.849534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd09ae-8337-459d-a34e-966217faf5be None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.853572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 385/778] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:21.855159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.855677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.856157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.874015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:21.875508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:21.946465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 386/779] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:21.947781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:21.954900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd09ae-8337-459d-a34e-966217faf5be None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:21.989687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:21.990394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:21.990678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:21.990954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:21.998248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:21.999733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.018390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 15:45:22.024439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 394/780] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:22.024439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.061939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef48c7-87ec-49d9-a52e-f6f38563ae97 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.104624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.105645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.106136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.106721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.107818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] RBAC: Adding query filter params (interface=public, service_id=baf62eb9e09d43c5aa2dfd8a8f3a7949, region_id=RegionOne) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:22.108721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.110683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.120771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 387/781] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:21 2022] GET /identity/v3/endpoints?service_id=baf62eb9e09d43c5aa2dfd8a8f3a7949&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:22.122581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.136132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b0edd-042b-4d62-b0f8-d1c73db88cc7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.179898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.181212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.181972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.182452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] PATH_INFO: `/v3/services/network` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.183330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.185348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.202982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 29 15:45:22.204773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 395/782] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:22.205740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.245620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84349503-a78f-40a9-8f2d-2db9050ac439 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.291204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.292486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.293122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.293607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.295836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:22.296780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.299541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.312220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d94f55-735f-429b-bdbc-81844820280f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.326466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 388/783] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:22.327311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.355780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.357185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.357911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.358387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.359271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.361818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.368903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 396/784] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:22.369929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.490823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123dd7-58f9-43c1-9e79-8995fb688992 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.530933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.532114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.532585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.533042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.533569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf55a-aebb-4bd6-a525-b21cffd3ba0e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.546586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.548391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.568621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:22.570624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 397/785] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:22.576292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.624298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.624984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.625266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.625538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.626250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:22.626555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.627973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.646495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 389/786] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:22.656395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.713284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490bb71-9515-4c1e-a604-188166c7a48b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.757242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.757832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.758115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.758388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.759116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:22.759422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.760831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.775667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 398/787] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:22.782065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.786364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07270773-621f-42c3-a1d6-66f377d833f1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.826782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.827844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.828336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.828828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.829767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] RBAC: Adding query filter params (type=network) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:22.830274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.831973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.838551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 390/788] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:22.844919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.893636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b8842-835a-40d1-8d1f-d97ba680f748 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.929033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.929827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.930112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.930390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.937637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.939106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:22.946945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450117f-235a-43bc-8272-8e2ad80c4ce9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:22.953178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:22.954706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 399/789] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:22.973152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:22.989850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:22.990762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:22.991195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:22.991726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:22.992743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] RBAC: Adding query filter params (interface=public, service_id=51070838b38840c1932c40358781a537, region_id=RegionOne) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:22.993270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:22.994871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:23.001430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 391/790] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/endpoints?service_id=51070838b38840c1932c40358781a537&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:23.008345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.124589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052996b1-284d-4eff-84a7-3587d86b81b0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.154031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6d96-737c-4163-89c6-02d3ef513ed3 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.165754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdec91-2d91-4be6-bbd8-0a4dbbd848fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.166425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdec91-2d91-4be6-bbd8-0a4dbbd848fb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.166709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdec91-2d91-4be6-bbd8-0a4dbbd848fb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.166984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdec91-2d91-4be6-bbd8-0a4dbbd848fb None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.167703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdec91-2d91-4be6-bbd8-0a4dbbd848fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:23.169725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdec91-2d91-4be6-bbd8-0a4dbbd848fb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:23.177394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 392/791] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:23.178947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31feab-1e47-408d-839e-8c0ab9bcb1b7 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.179467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31feab-1e47-408d-839e-8c0ab9bcb1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.179988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31feab-1e47-408d-839e-8c0ab9bcb1b7 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.182301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 393/792] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:23.187806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.188092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.188365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.205867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:23.211734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:23.230500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.231177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.231461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.231763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.232567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:23.232879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:23.234355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:23.260136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 400/793] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:23.265846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.303890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 394/794] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:23.328342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.449761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa84ce-434d-4717-a9db-5479ed116e0e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.456575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e292f-cbc4-46ec-bbc4-7bb8c647d4b3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.487252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.489083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.489593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.490066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/7152e01448494ebd98eb204c3e602a77/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.492332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=7152e01448494ebd98eb204c3e602a77, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:23.494009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:23.502108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be383ac9-e528-4a12-811a-3acac4d6fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.502966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383ac9-e528-4a12-811a-3acac4d6fc44 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.503253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383ac9-e528-4a12-811a-3acac4d6fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.504392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be383ac9-e528-4a12-811a-3acac4d6fc44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.511139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 401/795] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:23 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/7152e01448494ebd98eb204c3e602a77/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:23.516333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be383ac9-e528-4a12-811a-3acac4d6fc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:23.523985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-be383ac9-e528-4a12-811a-3acac4d6fc44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:23.530788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 395/796] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:23.532208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.568413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2067fc-9f89-4d76-bbd0-dd1a70a46205 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.568718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2067fc-9f89-4d76-bbd0-dd1a70a46205 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.568975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2067fc-9f89-4d76-bbd0-dd1a70a46205 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.574941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 396/797] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:23.576853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.577146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.577426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.598126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:23.599330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:23.728359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364b54e-7ed0-43cf-8011-f0c7d3ac786e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.743739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 397/798] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:23.771371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.775386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.776158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.776442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.776720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.777476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:23.777782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:23.779171 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:23.787911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 402/799] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:23.793491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.875981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557a63c-62a8-428c-892d-466f2294ff14 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.899237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32b17d-c3c9-467c-aab0-24dd7bb5c938 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:23.910139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.910942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.911274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.911571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.922793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:23.930658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:23.934565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:23.935368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:23.935679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:23.935958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:23.936831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 398/800] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:23.938092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:23.949588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:23.951556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:23.972965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:23.975409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 403/801] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:23.980397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.099962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dcfb0-7011-41d2-9e8e-24897ba73c60 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.136437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.137248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.137956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.138337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.139462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:24.139906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.141425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.141818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52543ae8-2af4-4cde-9717-289e9f4903c8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.151865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 399/802] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:24.157681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.185227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.186270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.187860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.188343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.189266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:24.190076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.192483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.214456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 404/803] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:24.221308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.291854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0074e-50ae-48d3-8ba5-8b3cfcfac958 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.346750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.348090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.348376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.348654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.376716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.378101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.386900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96a6b-7427-4876-8192-c35e777b23e7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.412094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:24.413669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 400/804] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:24.419064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.427698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.427698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.427698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.427698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.442808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.444295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.466114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 15:45:24.467328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 405/805] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:24.477089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.619144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52985283-ba43-4b94-8d4c-a2ddd80a1817 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.628936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde0f8-911a-4c40-9efd-d71629ba0163 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.670184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.670856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.671137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.671410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.672273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:24.672577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.674003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.689449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.690112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.690394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.690668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.691465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:24.691794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.693155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.713090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 406/806] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:24.718966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.723329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 401/807] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:24.727747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.837913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8ce3f-2120-4291-9f4c-3bb5d36d3dd0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:24.879725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:24.880522 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:24.880730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:24.881007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:24.895872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:24.897344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:24.927581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:45:24.928988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 402/808] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:24.936350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:24.954090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fcb09a-2309-4e3b-96bc-2ebdd1afa658 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.017008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.017815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.018094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.018368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.038399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.039888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.073249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:25.087153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 407/809] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:25.088062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.150226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05c6b5-fb49-419e-85a2-dca5d9e1b012 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.210513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87995d05-97e0-4b9e-82ac-560cc6bb563b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.240080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.240813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.241102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.241384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.242232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:25.242545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.244028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.254235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.254910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.255190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.255462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.256218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:25.256523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.257899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.274825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 403/810] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:45:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:25.285996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.286409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 408/811] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:25.289896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.443216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fb7cc-8321-470b-8aca-757bf08c21e8 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.452888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276402b-0621-48be-aeef-8b28fc59462b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.482588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1d7ef-6bc1-4d33-97c2-2ac921494716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.483504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d7ef-6bc1-4d33-97c2-2ac921494716 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.483835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d7ef-6bc1-4d33-97c2-2ac921494716 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.484275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1d7ef-6bc1-4d33-97c2-2ac921494716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.493746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.494540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.495232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.495511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.504209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.506111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.523992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-747749e6-9b46-4047-a8e6-9a308780d033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:25.525541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 409/812] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:25.526915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c1b3-0360-4218-95cb-04dbc182c096 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.527202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c1b3-0360-4218-95cb-04dbc182c096 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.527477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c1b3-0360-4218-95cb-04dbc182c096 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.534173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 410/813] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:25.535284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c1b3-0360-4218-95cb-04dbc182c096 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.571171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d7ef-6bc1-4d33-97c2-2ac921494716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.573180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1d7ef-6bc1-4d33-97c2-2ac921494716 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.659338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c1b3-0360-4218-95cb-04dbc182c096 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.688344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 404/814] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:45:25.689678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.689973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.690250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.694556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.695219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.695506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.695900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.696687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:25.696998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.698440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.707386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:25.708611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:25.715901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 411/815] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:25.716812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.778896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 405/816] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:25.779774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.824519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58a541-e510-440b-92a1-557b74515061 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.858532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.859374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.859692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.859972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.871026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.872533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.878317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f325e-75c7-4f4b-afb2-475ef0553761 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:25.889953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:25.891603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 412/817] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:25.892534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:25.913457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:25.914351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:25.914637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:25.914911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/982d0437047a4e6bb92851c916d6d4d8/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:25.929569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=982d0437047a4e6bb92851c916d6d4d8, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:25.931013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:25.944541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 406/818] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:25 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/982d0437047a4e6bb92851c916d6d4d8/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:25.945412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.016547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a667fd-1049-424e-a5fc-8806a4ff7411 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.061591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.063144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.063496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.064036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.064884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.067388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.076612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1d4cc-370f-4a2d-b228-cb365826f292 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.082705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-0c036785-227d-4e5e-affb-4ca09b37398c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 29 15:45:26.084366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 413/819] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:26.085719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeeb02-8b5f-4994-b502-ec63e1b1ea78 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.086006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeeb02-8b5f-4994-b502-ec63e1b1ea78 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.086286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeeb02-8b5f-4994-b502-ec63e1b1ea78 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.088640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 414/820] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:26.094724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708d805-a5fb-4ffa-b923-1b03c4a39b79 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.095004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708d805-a5fb-4ffa-b923-1b03c4a39b79 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.095282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708d805-a5fb-4ffa-b923-1b03c4a39b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.120681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3708d805-a5fb-4ffa-b923-1b03c4a39b79 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:26.122560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3708d805-a5fb-4ffa-b923-1b03c4a39b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:26.125467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.126285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.126640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.126989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.127854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:26.128232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.129742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.147640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 407/821] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:26.147640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.204858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 415/822] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:26.206394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f1d7-4913-40c6-854d-88e8081ee49a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.206862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f1d7-4913-40c6-854d-88e8081ee49a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.207284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f1d7-4913-40c6-854d-88e8081ee49a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.209104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 416/823] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:26.214133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f1d7-4913-40c6-854d-88e8081ee49a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.256406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61716308-97e8-43be-a52c-25bda434f884 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.288961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.289632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.289919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.290203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.290910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:26.291220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.292646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8b202-415b-4fd2-bb9e-1bf88a5c8a00 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.297048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 408/824] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:26.297048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.297048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.297048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.317690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:26.318868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:26.320664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f1d7-4913-40c6-854d-88e8081ee49a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.353297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.354092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.354378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.354661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.361340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.363312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.377112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:26.378319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 417/825] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:26.379152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.399549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 409/826] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:26.399549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.491840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc91f-9154-44c3-a1f4-d61cd88dba77 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.497130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c03d9-7f80-4c10-8d68-4886c02ab095 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.525572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.526368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.526657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.526939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] PATH_INFO: `/v3/services/network` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.527622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.529019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.533023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.533695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.533982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.534260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.535002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:26.535342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.536743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.540159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 29 15:45:26.550307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 418/827] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:26.550453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 410/828] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:26.550553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.550626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.636215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c371b3-f1c3-490b-9805-d3dddc43a7ce None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.647605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc013b3-2216-4389-8596-01c71115ff95 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.672368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.673488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.673915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.674342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.681365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.682031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.682318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.682597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.683387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:26.683728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.685162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.685466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:26.692932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:26.694268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 411/829] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:26.695155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.702070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 419/830] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:26.702885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.796848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808d59e-3140-4d31-a245-b729995d77d2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.807739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d182be-8634-4cc3-9ddc-1a36ecf6f289 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.829232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.829900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.830187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.830462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.831159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] RBAC: Adding query filter params (name=network) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:26.831470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.832893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.841912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 412/831] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:26.841912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.845011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:26.845675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:26.845955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:26.846230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:26.846970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:26.848886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:26.868319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 420/832] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:26.869238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:26.956722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b72d50-5227-478f-a333-cb69303294fe None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:26.999509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.000694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.001252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.001723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.002683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:27.003410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.005101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.015240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 413/833] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:27.016516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:27.016788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd824b-36d7-408d-90b1-476c23ecd68f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.063791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.064791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.065769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.066318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.067570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=ba546b8ade2443a096e7f303d609b622) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:27.067570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.069142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.076254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 421/834] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:26 2022] GET /identity/v3/role_assignments?user.id=ba546b8ade2443a096e7f303d609b622&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:27.077328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:27.160922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cab6dc-3534-4797-b487-5fec3c9fa0f7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.198232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.199168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.199473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.199887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.200736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] RBAC: Adding query filter params (type=network) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:27.201153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.202734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.207326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4376143-132b-4a31-bdbd-376b4944afed None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.209706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 414/835] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:27.217044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:27.267705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.268891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.269484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.269960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.286662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.293149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.314793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:27.321520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 422/836] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:27.322767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:27.345258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193970a9-806e-49f2-ad77-15acc9cc0785 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.391274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.392413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.392704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.393130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.394076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.396145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.429758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 415/837] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:27.449889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96362-de21-4e1b-bb88-c3b4f5e4d485 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.495226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.495943 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.496236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.496515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.497254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:27.497565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.498969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.513049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 423/838] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:27.518852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:27.652195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d37284-fd31-4ce7-8523-cf980841425e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.688446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.689604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.690093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.690572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.698873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.700658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.715199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 29 15:45:27.721399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 416/839] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:27.725597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:27.834852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f858e-eba8-4473-b822-bddbaa7f21b1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:27.872117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:27.873139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:27.873626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:27.874127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:27.875176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:27.875722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:27.877367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:27.899628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 424/840] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Mar 29 15:45:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:27.902032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.007116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5f970-9441-4907-9131-daacc0258af2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.041234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53470cc0-9c09-4229-a5eb-18d9d1b33c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.041886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470cc0-9c09-4229-a5eb-18d9d1b33c3d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.042170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470cc0-9c09-4229-a5eb-18d9d1b33c3d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.042452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53470cc0-9c09-4229-a5eb-18d9d1b33c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.109783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470cc0-9c09-4229-a5eb-18d9d1b33c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:28.111178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53470cc0-9c09-4229-a5eb-18d9d1b33c3d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:28.213270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 417/841] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:27 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:45:28.219009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.323753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b52b-dedf-45d2-89d8-007a90413850 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.330776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb657d-e697-44f7-8173-a482d0f93e84 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.331059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb657d-e697-44f7-8173-a482d0f93e84 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.331340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb657d-e697-44f7-8173-a482d0f93e84 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.333456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 418/842] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:28.338644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.338931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.339186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.356106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:28.357264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:28.362982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.364054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.364552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.364832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.374856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:28.376339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:28.394993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:28.400917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 425/843] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:28.402555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.439219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 419/844] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:28.457447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.514123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13584ff-df71-4a75-889f-e19825f53a03 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.568532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.569533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.570244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.570804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.572019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:28.572667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:28.573964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:28.582169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fed58-f4ff-4a04-9c30-51ca0cc5cedb None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.591233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 426/845] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:28.592496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.623313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.624511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.624939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.625652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.639850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:28.649471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:45:28.651637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 420/846] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:28.657724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.705132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebd26-ba24-47cb-9901-5ae854d519da None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.739094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.740051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.740409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.740808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.750605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:28.752466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:28.772754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:28.778686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 427/847] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:28.779965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.785470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974c006-b952-4891-9d8e-073e5b8bddd5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.828932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.830115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.830848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.831402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.832860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:28.833362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:28.835739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:28.847075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 421/848] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:28.852473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.883985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5eba5-f1f1-465a-b719-29e1d402cefe None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:28.917983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:28.918634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:28.918913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:28.919185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:28.920212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:28.920655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:28.922738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:28.939924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 428/849] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:28.942189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:28.976585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837f532-b8f2-4b35-953c-bbb3ae5da02c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.009963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.011501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.011998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.012471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.023542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.025330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.042335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:29.044167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 422/850] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:29.050100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.068458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960418e-724b-4436-b89a-fe034510a12a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.103078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.104141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.104621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.105126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.106161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=7152e01448494ebd98eb204c3e602a77) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:29.106713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.108389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.119040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 429/851] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:28 2022] GET /identity/v3/role_assignments?user.id=7152e01448494ebd98eb204c3e602a77&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:29.179244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a1d1-cf1e-42a7-b2a6-e441146668fc None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.215672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.216710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.217190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.217686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.218635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:29.219150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.220812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.235442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 423/852] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:29.244191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.352137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46335d9f-2d10-4e66-bf23-233d5075b87d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.387805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.388656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.388939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.389215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.398170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.399699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.415036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-3e236d6e-06d0-44bd-bed9-b05004827200 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 15:45:29.421077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 430/853] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:29.424617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.497761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64571a-44ac-4176-94a1-85c35c0f216b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.498084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64571a-44ac-4176-94a1-85c35c0f216b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.498323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64571a-44ac-4176-94a1-85c35c0f216b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.500776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 431/854] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:29.506779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.507072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.507355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.524610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:29.525806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:29.536414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649d317-ed41-4aca-b928-12fcc6b5dbb3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.571726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.572455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.572748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.573026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.573876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:29.574185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.575654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.595123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 424/855] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:29.601583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.611565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 432/856] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:29.634435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.727579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7dfeb-b1af-4d9e-a568-ac371b5d7f20 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.745042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f364a9-4f87-4873-acfc-b9e1f99453b6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.771360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee530ab6-43c1-4bd3-8060-b88e2668da2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.772646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530ab6-43c1-4bd3-8060-b88e2668da2d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.772976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530ab6-43c1-4bd3-8060-b88e2668da2d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.773258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee530ab6-43c1-4bd3-8060-b88e2668da2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.781465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.782256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.782534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.783101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.783447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.785392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.796628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2198cac1-6559-404b-903b-9071d53c1fe8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 29 15:45:29.801924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 433/857] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:29.801924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1478d-5c29-4102-8e0a-2685b152eb53 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.801924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1478d-5c29-4102-8e0a-2685b152eb53 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.801924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1478d-5c29-4102-8e0a-2685b152eb53 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.801924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 434/858] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:29.805842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1478d-5c29-4102-8e0a-2685b152eb53 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.846860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee530ab6-43c1-4bd3-8060-b88e2668da2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.848944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee530ab6-43c1-4bd3-8060-b88e2668da2d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.911972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1478d-5c29-4102-8e0a-2685b152eb53 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:29.945945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:29.946609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.946897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.947172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.947910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:29.948218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:29.949601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:29.952263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 425/859] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:45:29.953474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168a43-a815-447c-90c2-637508c4c137 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:29.953772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168a43-a815-447c-90c2-637508c4c137 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:29.954054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168a43-a815-447c-90c2-637508c4c137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:29.954466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 435/860] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:29.955162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:29.974621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-27168a43-a815-447c-90c2-637508c4c137 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:29.975815 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-27168a43-a815-447c-90c2-637508c4c137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:30.047758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 426/861] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:30.049434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168a43-a815-447c-90c2-637508c4c137 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.057954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0c654-cd13-495e-8178-81b088aaeeac None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.090752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.091569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.091851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.092122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.102659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.104167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.120748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:30.126754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 436/862] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:30.126754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.149600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168a43-a815-447c-90c2-637508c4c137 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.183187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.183881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.184166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.184442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.185141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:30.185450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.186818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.191267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 427/863] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:30.192083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.245420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c82a2d-b027-4224-bcdb-9aae4e67cb8b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.292549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.293971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.294454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.295090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.296353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.298164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.311696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6219-c7cb-44c0-b47a-33c9e885bb1a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.315839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 29 15:45:30.317736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 437/864] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:30.323416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.357573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.358266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.358552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.358830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.359625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:30.360008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.361587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.380076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 428/865] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:30.381411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.454164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac85e2-3fc3-483f-aa13-5aa33273ba2c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.488191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.488861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.489143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.489418 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.490125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:30.490432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.491823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.495864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687917d-bb70-4e5b-8c94-8a45221d37fb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.496556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 438/866] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:30.501993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.540613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.541424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.541707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.541981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.551186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.553049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.571155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:30.573435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 429/867] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:30.581153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.605832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa46-7516-46da-9ce6-fe81478f0994 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.640100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.640823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.641107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.641438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.642156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:30.642464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.644448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.649265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 439/868] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:30.697260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f866f-368b-427d-92ed-e1f8917be316 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.736978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.738195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.738480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.738758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.739584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:30.739900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.741357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230f326-b852-4a25-b49b-39b119839567 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.754388 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 430/869] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:30.760344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:30.867997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef0a47-d933-4e05-a8b5-1ed998d7f18b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:30.901343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:30.902001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:30.902288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:30.902569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:30.903403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=982d0437047a4e6bb92851c916d6d4d8) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:30.903746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:30.905186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47421696-e895-4491-beb3-10a78e7544b7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:30.911487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 440/870] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:30 2022] GET /identity/v3/role_assignments?user.id=982d0437047a4e6bb92851c916d6d4d8&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:31.559095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ebbae-56eb-46fc-a59d-829546165116 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:31.559656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ebbae-56eb-46fc-a59d-829546165116 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:31.559743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ebbae-56eb-46fc-a59d-829546165116 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:31.561710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 431/871] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:31.567086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:31.567518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:31.567722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:31.585074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:31.586520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:31.656121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 441/872] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:31.686084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ebbae-56eb-46fc-a59d-829546165116 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:31.790858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ebbae-56eb-46fc-a59d-829546165116 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:31.825382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:31.826119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:31.826459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:31.826745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:31.827404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:31.828813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:31.841354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 15:45:31.843048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 432/873] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:31.849796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:31.950454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d4df1-d77b-4d7c-9013-9d5dff9b5759 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:31.989879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:31.990561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:31.990846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:31.991125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:31.991875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:31.992187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:31.993565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40646-9ccc-413a-afd3-b4f9dd513b63 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:31.999302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 442/874] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:32.005354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:32.107878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b557bbc-d53f-47cc-b40f-315cf5ffdc8f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:32.143514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:32.145527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:32.146062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:32.146557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:32.147619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:32.148145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:32.149827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8dd0-8d47-4d10-9a58-ce5411ace1c1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:32.155229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 433/875] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:32.571096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe072d-48d0-441a-acf1-496dcaf6d270 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:32.571658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe072d-48d0-441a-acf1-496dcaf6d270 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:32.571658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe072d-48d0-441a-acf1-496dcaf6d270 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:32.573756 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 443/876] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:32.579187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5454-455c-4daa-8619-1a97de224f1b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:32.579670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5454-455c-4daa-8619-1a97de224f1b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:32.579862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5454-455c-4daa-8619-1a97de224f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:32.598062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b52a5454-455c-4daa-8619-1a97de224f1b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:32.599241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b52a5454-455c-4daa-8619-1a97de224f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:32.673107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 434/877] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:32.696756 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe072d-48d0-441a-acf1-496dcaf6d270 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:32.806030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe072d-48d0-441a-acf1-496dcaf6d270 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:32.841334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a56db8-f1f0-45da-af2c-a08ce5474f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:32.841931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a56db8-f1f0-45da-af2c-a08ce5474f34 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:32.842211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a56db8-f1f0-45da-af2c-a08ce5474f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:32.842485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a56db8-f1f0-45da-af2c-a08ce5474f34 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:32.843212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a56db8-f1f0-45da-af2c-a08ce5474f34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:32.844628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a56db8-f1f0-45da-af2c-a08ce5474f34 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:32.867710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 444/878] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:32 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:33.069375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21f67-8e80-4c88-bbde-a2d4cacdfaf5 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.070040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21f67-8e80-4c88-bbde-a2d4cacdfaf5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.070550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21f67-8e80-4c88-bbde-a2d4cacdfaf5 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.072827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 435/879] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:33.078242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca568c-6359-4e6a-8492-a1ce1dfb02c1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.078541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca568c-6359-4e6a-8492-a1ce1dfb02c1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.078824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca568c-6359-4e6a-8492-a1ce1dfb02c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.096813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b8ca568c-6359-4e6a-8492-a1ce1dfb02c1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:33.097930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b8ca568c-6359-4e6a-8492-a1ce1dfb02c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:33.169668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 445/880] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:33.193084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21f67-8e80-4c88-bbde-a2d4cacdfaf5 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:33.295953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21f67-8e80-4c88-bbde-a2d4cacdfaf5 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:33.333073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:33.334104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.334623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.335099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.336311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:33.337941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:33.353169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fc289-7973-4f54-88a9-3aafbb361b63 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.353453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fc289-7973-4f54-88a9-3aafbb361b63 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.353683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fc289-7973-4f54-88a9-3aafbb361b63 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.355708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 446/881] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:33.357200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 436/882] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:33 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:33.360961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.361249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.361524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.383216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:33.384878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:33.463829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 447/883] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:33.488967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:33.592489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65e7c-d18e-4d2e-965c-5c19c5901c8c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:33.627984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:33.628739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.629027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.629308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.639786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:33.647804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 15:45:33.649321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 437/884] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Mar 29 15:45:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:33.654956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:33.757034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00871839-37bd-4e91-9d47-99f000edcb36 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:33.791394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:33.792097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.792381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.792655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.793403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:33.793714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:33.795087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:33.804099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 448/885] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:45:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:33.810421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:33.916034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69232b1-b6ba-4068-b00a-4da651204944 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:33.951699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:33.952523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:33.952811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:33.953085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:33.966492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:33.968014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:33.985078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:33.986602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 438/886] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:33.992307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:34.098940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f3d8-2e74-475d-b27e-ce6dfa82c119 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:34.132824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:34.133494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.133778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.134054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.134774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:34.135086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:34.136551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:34.153138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 449/887] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:34.154679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:34.264186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e45d8-e948-44a4-9bdf-bc9766a755fd None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:34.298096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:34.299254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.299853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.300336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.308160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:34.309887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:34.324461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 15:45:34.326343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 439/888] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:45:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:34.332462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:34.439052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb824ea-0be8-4cc4-840e-b0d2008f7cb6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:34.474115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:34.474793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.475079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.475357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.476228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:34.476542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:34.477980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e5ef-9dfb-4cc4-ad3b-34315cd01915 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:34.502123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 450/889] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Mar 29 15:45:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:34.503607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:34.607217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679424-7612-4220-9127-17cf54f3c2eb None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.607422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679424-7612-4220-9127-17cf54f3c2eb None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.607912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679424-7612-4220-9127-17cf54f3c2eb None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.610157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 451/890] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:34.615808 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a511b8-ad31-425a-8aab-ea354b0a0b31 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:34.617659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.618174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.618655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.638739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:34.640710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:34.646554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:34.647208 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.647496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.647807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.717082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:34.718536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:34.733462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 452/891] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:34.756217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:34.850195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 440/892] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:34 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:45:34.856204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:34.859411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2330c7-30d0-4020-8405-aef7be5a4886 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:34.900036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:34.901083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:34.901190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:34.901550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:34.902547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:34.903928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:34.927806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 453/893] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:34 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:34.991296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6096c80-5fd5-4dc0-821b-d01d3fbbd044 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.035845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.036707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.036993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.037266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.048523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.050074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.069152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:35.074638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 441/894] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:35.076626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.180513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1b31f-bd71-46c7-907c-cc42a395255e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.214393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.215069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.215348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.215652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.216381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:35.216688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.218070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2817b-7d50-46a6-930d-452126c0338b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.234848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 454/895] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:35.236251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.261216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0af3-e9a3-47b8-a45d-60e0ff8e4706 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.261664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0af3-e9a3-47b8-a45d-60e0ff8e4706 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.261954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0af3-e9a3-47b8-a45d-60e0ff8e4706 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.264831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 455/896] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:35.269729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.270015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.270292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.290923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:35.292417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:35.342538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3334-b3b6-46bd-8d4d-911f4f66865a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.383675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 456/897] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:35.383896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.383896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.383896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.383896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.390689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.392375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.401407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.413922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:35.416302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 442/898] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:35.422682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.524493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52dd40-46a7-4151-ab02-ab02cd31c101 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.542446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9d4fe-c407-44f3-8d6b-c9ac77f58e99 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.564503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.565936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.566708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.567065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.567852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.569812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.581614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.582478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.582952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.583400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.584211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 29 15:45:35.584566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:35.585043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.590769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 457/899] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:35.590891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.592202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.607293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 443/900] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:35.608714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.692808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a94d07-a248-4db7-bb58-ebcc4c51cb57 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.710692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5db8ec-2c5c-4863-b7b0-51f39e98efae None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.727288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.728341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.728829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.729340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.730253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:35.730759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.732357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.742630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 458/901] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:35.744259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.746304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.746981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.747265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.747576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.748529 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] RBAC: Adding query filter params (role.id=cfdc67df5250453ea019be9606758506, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=982d0437047a4e6bb92851c916d6d4d8) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:35.748737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.750537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1fe54-c3c5-4dcb-8b8a-14e8db015d7f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.763667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 444/902] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/role_assignments?user.id=982d0437047a4e6bb92851c916d6d4d8&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=cfdc67df5250453ea019be9606758506 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:35.797105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2376e6-b192-4f12-ac83-04bacafd6baf None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.797411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2376e6-b192-4f12-ac83-04bacafd6baf None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.797593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2376e6-b192-4f12-ac83-04bacafd6baf None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.803729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 445/903] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:35.805154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.805430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.805713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.823470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:35.824737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:35.863129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dded2-2a07-4934-8838-a4775f5795ba None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:35.899811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 446/904] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:35.901902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:35.902821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:35.903316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:35.903828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:35.904791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:35.905303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:35.906893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:35.913158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 459/905] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:35.917619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:35.919644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:36.029031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9c303-a86a-4726-90e8-bb06cdf6075e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.032922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65155a-3e75-472d-a49f-f193b1aa8db3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.062507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.063103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.063378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.063689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.064485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] RBAC: Adding query filter params (interface=public, service_id=09b0ad9872f6462eab9f272fca525dae, region_id=RegionOne) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:36.064803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.066223 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.078302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 460/906] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/endpoints?service_id=09b0ad9872f6462eab9f272fca525dae&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:36.079227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.080080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.080367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.080648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.081607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:36.081839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.083225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.103323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 29 15:45:36.107604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 447/907] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Mar 29 15:45:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:36.110825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:36.205245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6ca4d-0198-4cac-8a24-89786834246a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.223868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfd81b-875b-4137-9f03-47f9e53f30c4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.239591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.240537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.241035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.241519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.242390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.244043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.256008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 461/908] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:36 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:45:36.263485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.264211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.264500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.264786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.265514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:36.265823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.267235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.273240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 448/909] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:36.279030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:36.388571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1afe8-fad1-4e1a-93bf-825f482207fe None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.424887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.425564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.425851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.426131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.426853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:36.427160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.428761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.434608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 462/910] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:36.441044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:36.545580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fbd2-4dca-48e2-9aad-5c0d3d2aef1f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.580251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.581330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.581816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.582291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.583313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] RBAC: Adding query filter params (interface=public, service_id=2271c9cb934f4a0b96240fc3ddc2dceb, region_id=RegionOne) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:36.583855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.585435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b0eb-9a19-48b3-8726-997d092906b1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.591449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 449/911] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:36 2022] GET /identity/v3/endpoints?service_id=2271c9cb934f4a0b96240fc3ddc2dceb&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:36.597749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:36.696072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd892b0a-cf5e-481d-b7c6-f501ad7e6620 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:36.730445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f0a5-f7e6-406a-8572-b717583eda6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:36.731452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f0a5-f7e6-406a-8572-b717583eda6e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:36.731994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f0a5-f7e6-406a-8572-b717583eda6e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:36.732463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f0a5-f7e6-406a-8572-b717583eda6e None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:36.733368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4f0a5-f7e6-406a-8572-b717583eda6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:36.734929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4f0a5-f7e6-406a-8572-b717583eda6e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:36.741883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 463/912] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:36 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:45:37.309371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e379fc-9161-4d25-a74c-1e0b634a76d6 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:37.309908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e379fc-9161-4d25-a74c-1e0b634a76d6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:37.309908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e379fc-9161-4d25-a74c-1e0b634a76d6 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:37.311843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 450/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:37.317311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:37.317720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:37.317921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:37.335314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:37.336765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:37.403259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 464/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:37.426513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e379fc-9161-4d25-a74c-1e0b634a76d6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:37.534944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e379fc-9161-4d25-a74c-1e0b634a76d6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:37.568543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:37.569371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:37.569661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:37.569942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:37.570662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:37.572113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:37.584191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 15:45:37.585660 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 451/915] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:37.591630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:37.691805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a14c34-f9e2-419d-996a-1ef44e677dbc None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:37.725572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:37.726245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:37.726537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:37.726817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:37.727549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:37.727862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:37.729274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:37.734420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 465/916] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:37.740863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:37.860665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48170c0-3986-41a0-b747-78e475196327 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:37.894390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:37.895065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:37.895353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:37.895666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:37.896382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:37.896691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:37.898054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:37.903385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 452/917] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:37.909784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.013487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5a2e5-54ff-40c9-a52a-25205b1410a7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.048057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.048792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.049082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.049353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.050291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] RBAC: Adding query filter params (interface=public, service_id=48dde0091e3b49d1b273715c90e17a3d, region_id=RegionOne) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:38.050602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:38.052073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97197d80-4e11-4e9a-8354-f72b108dd521 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:38.057759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 466/918] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:37 2022] GET /identity/v3/endpoints?service_id=48dde0091e3b49d1b273715c90e17a3d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:38.064835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.153204 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97447-03a5-40e2-af1c-ac1a4dc00d8b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.153508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97447-03a5-40e2-af1c-ac1a4dc00d8b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.153699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97447-03a5-40e2-af1c-ac1a4dc00d8b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.155639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 467/919] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:38.160608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.160900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.161182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.179308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424c733-a4d0-4217-a346-c68c9d5ea592 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.181327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:38.183234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:38.214304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.215098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.215459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.215823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.216568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:38.218063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:38.235557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 453/920] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:45:38.257976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 468/921] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:38.283324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.397121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1636-e012-41e4-966a-da5303898c84 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.433357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.434508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.434997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.435474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.446490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:38.454321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 15:45:38.461526 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 454/922] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:38.463116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.570848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dee01-5637-43c3-a391-ad60c61f0f2c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.604853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.605520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.605799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.606069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.606812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:38.607116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:38.608512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b8413-43b1-4f71-ab53-aaec35fac13f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:38.617064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 469/923] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:38.622873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.685866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319fd17-bc8f-4612-b18d-12899cdf03cf None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.686146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319fd17-bc8f-4612-b18d-12899cdf03cf None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.686356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319fd17-bc8f-4612-b18d-12899cdf03cf None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.688183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 470/924] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:38.693653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.693944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.694228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.712638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:38.714101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:38.726897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d544f25-1364-48da-8034-204de84ce454 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.769992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.771054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.771709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.772546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.786732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:38.789223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:38.799771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 471/925] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:38.806329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:38.812163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 455/926] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:38.814367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.820656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.926267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9102cf2-029f-440e-82ef-c79dc00b2644 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.946490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295fd56-a64f-445c-82c4-dd340cbbfe30 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:38.961460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.962431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.962902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.963389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.964316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:38.964809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:38.966381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:38.983695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 472/927] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:38.985462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:38.989106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:38.990839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:38.991140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:38.991423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:38.992127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:38.993508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.007408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 29 15:45:39.011613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 456/928] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:39.014689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.115960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021d696-364e-47dd-930d-bfdfe5bf4a1b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.122000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b428be-00a7-4341-aaaf-14a839387a40 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.151798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.153025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.153559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.154084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.155291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:39.155819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.155921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.156807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.157157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.157495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.158189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.168491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.168491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.169281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 457/929] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:39.170341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.185294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-5cd92058-a93f-4636-a96d-1db47b97d836 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 15:45:39.191621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 473/930] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:45:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:39.193051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690b00d-4d47-4023-a43a-fc595b710731 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.193801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690b00d-4d47-4023-a43a-fc595b710731 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.194092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690b00d-4d47-4023-a43a-fc595b710731 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.195874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 474/931] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:39.196918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690b00d-4d47-4023-a43a-fc595b710731 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.271235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc6718-6215-4d05-83b9-5b0f61cd02bc None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.298072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690b00d-4d47-4023-a43a-fc595b710731 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.304276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.304943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.305235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.305582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.306292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:39.306629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.308043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23489b01-2745-48b3-9ff0-9f118351eceb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.317260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 458/932] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:39.317260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.317260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.317260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.330898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:39.332109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:39.335127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.336067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.336357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.336633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.337455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:39.337761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.339209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.361255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 475/933] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:39.361255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.402376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 459/934] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:39.403243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.475466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c7b98-c4fd-420a-b1d1-f747951ca16e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.497918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590aa70-c64d-48f9-92bd-0acf6da21146 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.508990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.510372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.511134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.511968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.513595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.515820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.532124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.532950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.533241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.533531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.537968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 476/935] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:39.539054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.544392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.545887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.566773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:39.572964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 460/936] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:39.573951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.685403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63fe69-c989-4f0e-9edb-f785bd3dd38d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.699804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b5939-f509-4777-b37b-a55c78129770 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.737496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.738676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.738969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.739248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.740030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.740505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.741230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.741417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.741637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.742003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.742744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:39.743176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.747546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.756848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 29 15:45:39.757867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 477/937] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:39.764275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.766394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 461/938] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:39.772147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.884150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c00d-2a5d-4ced-b0a2-1ee5b5e50db5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.888199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1f9c3-cbdc-47d3-a44d-08b86c9e84dd None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:39.919072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.920022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.920449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.920890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.921830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:39.922339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.924082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.928876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:39.929688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:39.929970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:39.930301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:39.930452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 478/939] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:39.936579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:39.941588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:39.943220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:39.957804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:39.963668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 462/940] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:39.965593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:40.056524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1521ce-55bd-48b2-810d-8ef65751824d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:40.070406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56ebe-0e0a-4f43-b729-c999bce79d91 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:40.091412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:40.092370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.092830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.093424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.094304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:40.094795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:40.096898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:40.106366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 479/941] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:40.107665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:40.109880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:40.110544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.110998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.111291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.113484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:40.113812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:40.115246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:40.134494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 463/942] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:40.135591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:40.225714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd115eb-e4c4-4137-b98f-57e5424ca4fb None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:40.252324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afd708-025a-41f7-a938-e76b56429a0e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:40.272457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be460f6-d424-475f-9e99-6cb2450496fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:40.273530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be460f6-d424-475f-9e99-6cb2450496fe None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.274033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be460f6-d424-475f-9e99-6cb2450496fe None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.274555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be460f6-d424-475f-9e99-6cb2450496fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.275489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be460f6-d424-475f-9e99-6cb2450496fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:40.277091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be460f6-d424-475f-9e99-6cb2450496fe None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:40.293862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11eb62e-bbde-4a36-88e7-817d8579cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:40.294767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eb62e-bbde-4a36-88e7-817d8579cf04 None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.295057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eb62e-bbde-4a36-88e7-817d8579cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.295346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11eb62e-bbde-4a36-88e7-817d8579cf04 None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/982d0437047a4e6bb92851c916d6d4d8/roles/cfdc67df5250453ea019be9606758506` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.297679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11eb62e-bbde-4a36-88e7-817d8579cf04 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=982d0437047a4e6bb92851c916d6d4d8, role_id=cfdc67df5250453ea019be9606758506)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:40.299248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11eb62e-bbde-4a36-88e7-817d8579cf04 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:40.307194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 480/943] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:40.320575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 464/944] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:40 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/982d0437047a4e6bb92851c916d6d4d8/roles/cfdc67df5250453ea019be9606758506 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:45:40.586905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d178-6b8a-4252-8def-7432639c7279 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.587384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d178-6b8a-4252-8def-7432639c7279 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.587384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d178-6b8a-4252-8def-7432639c7279 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.589470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 481/945] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:40.594502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.594932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.595078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.612565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:40.613742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:40.687268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 465/946] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:40.710610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365d178-6b8a-4252-8def-7432639c7279 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:40.826371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365d178-6b8a-4252-8def-7432639c7279 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:40.859720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:40.860454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:40.860735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:40.861012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:40.861662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:40.863087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:40.874462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 15:45:40.875919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 482/947] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:40.886686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:40.984388 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee93004-485c-48ee-8647-e1c2d7d4a1a9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:41.017631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:41.018383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:41.018669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:41.018953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:41.019695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:41.020010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:41.021380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:41.026315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 466/948] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:41.031691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:41.132342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b6de-6c19-42b2-9d4f-7b658a8ef175 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:41.165759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:41.166478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:41.166765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:41.167044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:41.167802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:41.168102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:41.169588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65369147-7b57-4bfe-9ac3-7301930dee13 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:41.175437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 483/949] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:41.181041 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:41.285313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c580eb-bdba-403e-8665-406bb41307e5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:41.319223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb09c5-c26e-44db-9103-e4d3f0ba0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:41.319921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09c5-c26e-44db-9103-e4d3f0ba0401 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:41.320211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09c5-c26e-44db-9103-e4d3f0ba0401 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:41.320493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb09c5-c26e-44db-9103-e4d3f0ba0401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:41.321249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb09c5-c26e-44db-9103-e4d3f0ba0401 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:41.322617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb09c5-c26e-44db-9103-e4d3f0ba0401 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:41.345146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 467/950] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:41.930011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fc9e-b0ed-4070-8e9a-c1064f8d8a15 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:41.931047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fc9e-b0ed-4070-8e9a-c1064f8d8a15 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:41.931793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646fc9e-b0ed-4070-8e9a-c1064f8d8a15 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:41.934783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 484/951] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:41.941069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:41.941888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:41.942358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:41.960024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:41.961762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:42.038883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 468/952] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:42.062592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fc9e-b0ed-4070-8e9a-c1064f8d8a15 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:42.165519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646fc9e-b0ed-4070-8e9a-c1064f8d8a15 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:42.199183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:42.200238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.200716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.201182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.202068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:42.203712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:42.206225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.common [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 29 15:45:42.225323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.sql.core [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 29 15:45:42.225323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 29 15:45:42.225323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [parameters: {'id': '1b530acbb2ad4ef596dd4955caab6731', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 29 15:45:42.225323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79739) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 29 15:45:42.232677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b530acbb2ad4ef596dd4955caab6731.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1b530acbb2ad4ef596dd4955caab6731. Mar 29 15:45:42.238332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 485/953] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Mar 29 15:45:42 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:42.240810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:42.342263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad3c5b-a350-49ac-aa7d-70402e92a61b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:42.377270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:42.378544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.379028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.379498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.387976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:42.389902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:42.405033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-576542c4-6fb2-4ce4-8008-74b6b6794d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:42.411678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 469/954] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:42.414437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:42.517402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345cdf5-3963-4eb6-a6c2-f11bce51775e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:42.550814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:42.551876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.552368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.552833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.553779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:42.554271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:42.556142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f80ec-a6cc-4d5a-900b-ee2bc4b8ea35 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:42.583685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 486/955] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:42.762367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623cd65-58b7-4c0f-8bc6-4897f20f7245 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.762367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623cd65-58b7-4c0f-8bc6-4897f20f7245 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.762367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623cd65-58b7-4c0f-8bc6-4897f20f7245 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.763442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 470/956] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:42.769610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.769745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.769953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.778343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed375-d4b6-4e1d-b922-5833165a12ca None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.778639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed375-d4b6-4e1d-b922-5833165a12ca None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.778921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ed375-d4b6-4e1d-b922-5833165a12ca None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.780854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 471/957] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:42.785916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:42.786203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:42.786483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:42.788864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:42.790503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:42.805085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:42.806828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:42.869933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 487/958] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:42.879508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 472/959] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:42.894846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:42.902009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.003362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c34d4-d7ff-47d5-8893-212b523f295d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.014316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c02d7-bd74-4f5b-a713-c9f511b7a6b0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.044475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.045733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.046138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.046559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.047359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.049432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.053656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.054473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.054756 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.055034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.062020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 29 15:45:43.063840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 473/960] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:43.065974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:43.071633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.073689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 15:45:43.077106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 488/961] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Mar 29 15:45:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:43.081609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.189368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c58c1-9af6-4d9e-a3be-8e1cd0dbe67d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.197979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53e692-1c18-4229-b836-dec758a4aed8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.222917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.223595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.223880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.224156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.224851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:43.225159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.226522 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.235849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 474/962] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:43.237195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.241589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.242496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.242964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.243457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.244409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:43.244910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.246924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.263053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 489/963] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:43.264892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.348195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4fdb6-39af-4ddc-8902-70081709a087 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.391784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.393779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.394219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.394644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.395499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] RBAC: Adding query filter params (type=compute) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:43.395844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7b7e-4155-4e67-be9e-f18ad1d25715 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.396231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.397922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.404217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 475/964] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:43.441195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.442324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.442819 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.443278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.457309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.459092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.478387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:43.480333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 490/965] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:43.486194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.592811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491155b2-7d9a-412f-9aa4-91c22bc95ecd None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.626954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.628550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.629062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.629524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.630437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:43.630926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.632510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3444e2a-c875-40f5-bada-07376c05112a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.645091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 476/966] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:43.650762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.708577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25782ba-db33-468f-b9d5-cdcbf3e1beff None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.708899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25782ba-db33-468f-b9d5-cdcbf3e1beff None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.709147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25782ba-db33-468f-b9d5-cdcbf3e1beff None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.711318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 477/967] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:43.716513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.716817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.717103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.737883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:43.739090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:43.767945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb209a-6d24-482b-a46c-de30a8bd02f0 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.806018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.807179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.807485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.807795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.817916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.819717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.826188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 478/968] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:43.843031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 29 15:45:43.844836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 491/969] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:43.850700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.852034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:43.952764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a942c6f-cf8a-4e40-9a2b-7872615d1b7d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.952984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885cc85-4bea-4273-943f-0079fe59ed94 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:43.986377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.987245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.987560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.987855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.988506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.988736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:43.989611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:43.989930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:43.990380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:43.990901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:43.991933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:43.992425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:43.994040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.001480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 15:45:44.007867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 492/970] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:44.009256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.017407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 479/971] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Mar 29 15:45:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:44.018879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.108101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae99e46-08ad-4644-8406-defdbf4ee912 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.116422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd03d-f000-4ffc-8f2b-16032d387be0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.142367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.143953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.144446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.144940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.145857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:44.146361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.147952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.150931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.151646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.151891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.152172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.158676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 493/972] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:44.159860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.220209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.221751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.260651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c234-5e60-44f2-b6d8-85b652348c9e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.294411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.295477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.296055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.296559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.297488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:44.298007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.300155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.305519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 494/973] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:44.313208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.331843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 480/974] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:45:44.334619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.416186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8232b-aadf-4979-9fc8-284db9206c8f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.432778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83c283-714c-4f4d-9984-f516c60bbcc2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.451158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.452216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.452759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.453237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.454286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] RBAC: Adding query filter params (interface=admin, service_id=48dde0091e3b49d1b273715c90e17a3d, region_id=RegionOne) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:44.454825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.457056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.467371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 495/975] 10.222.0.23 () {56 vars in 1249 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/endpoints?service_id=48dde0091e3b49d1b273715c90e17a3d&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:44.468173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.468977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.469323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.469607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.469958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.480434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.481909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.498964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:44.505493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 481/976] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:44.506326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.574187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc145b-8a44-4aa3-bd06-b0f4040d0586 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.607371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddac8a-44eb-4591-950f-daf22c13acf9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.609176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.610087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.610573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.611045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.612049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.613725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.627916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 496/977] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:45:44.643415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.644174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.644463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.644744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.645494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:44.645804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.647227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.660924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 482/978] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:44.666734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.782805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f59148-cb3b-4e94-a33e-1715447c4adf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.822487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.823296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.823605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.823942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.832638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.834136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:44.848893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:44.850367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 497/979] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:44.856180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:44.958667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9b3e3-7c64-4c3f-af4f-ba644fc29c2f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:44.992416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:44.993406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:44.993882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:44.994338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:44.995310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:44.995843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:44.997457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83a62-73a6-4135-94bc-3d1c6a7050fe None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:45.010471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 483/980] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:45.016645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:45.058707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6b97-0934-45e0-95a9-f303c177314b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.059692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6b97-0934-45e0-95a9-f303c177314b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.060230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6b97-0934-45e0-95a9-f303c177314b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.062596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 484/981] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:45.067962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.068493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.069137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.090708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:45.092257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:45.122318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36ff55-0663-45e6-b453-94f29c859e55 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:45.156783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:45.157712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.158157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.158643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.159658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] RBAC: Adding query filter params (role.id=cfdc67df5250453ea019be9606758506, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=982d0437047a4e6bb92851c916d6d4d8) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:45.160118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:45.161818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:45.168211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 498/982] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:45 2022] GET /identity/v3/role_assignments?user.id=982d0437047a4e6bb92851c916d6d4d8&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=cfdc67df5250453ea019be9606758506 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:45.176460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 485/983] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:45.201474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:45.308130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12b11b-e54c-48c0-b81b-582c85148a77 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:45.344712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:45.345395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.345696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.346490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.347223 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:45.349784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:45.362810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.sql.core [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 29 15:45:45.362810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 29 15:45:45.362810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [parameters: {'user_id': 'a6147dfa87e348a4885fbbef432a6e97', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 29 15:45:45.362810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79739) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 29 15:45:45.369023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 29 15:45:45.370711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 499/984] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Mar 29 15:45:45 2022] POST /identity/v3/users => generated 160 bytes in 170 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:45.376755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:45.484844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1bd1-ca4f-4db5-b59f-9b46b033692e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:45.520606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:45.521457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.521743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.522019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.529213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:45.530651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:45.544799 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-5021c32f-eeba-4478-b0c0-9132801c16d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 29 15:45:45.546050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 486/985] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:45.552079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:45.660073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cc9a5-a1bd-4518-91d3-9fd6ab3b630d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:45.694236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:45.694909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.695242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.695537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.696397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:45.696748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:45.698392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179e7f2-6bb3-48f6-bf4e-b8cc5a96e4ca None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:45.738468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 500/986] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Mar 29 15:45:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:45.755772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5a9f-77d1-47e4-9d25-9624d3e15729 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.756481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5a9f-77d1-47e4-9d25-9624d3e15729 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.756976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5a9f-77d1-47e4-9d25-9624d3e15729 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.759446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 487/987] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:45.770082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5ad7-6558-4060-b470-0b184d23e626 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:45.770732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5ad7-6558-4060-b470-0b184d23e626 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:45.771306 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5ad7-6558-4060-b470-0b184d23e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:45.789365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8d2d5ad7-6558-4060-b470-0b184d23e626 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:45.791248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8d2d5ad7-6558-4060-b470-0b184d23e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:45.864300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 501/988] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:45.887832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5a9f-77d1-47e4-9d25-9624d3e15729 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:45.993307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5a9f-77d1-47e4-9d25-9624d3e15729 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:46.028698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed6019-0641-460b-9bc4-de325b27eaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:46.029370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed6019-0641-460b-9bc4-de325b27eaf5 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:46.029650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed6019-0641-460b-9bc4-de325b27eaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:46.029924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed6019-0641-460b-9bc4-de325b27eaf5 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:46.030654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed6019-0641-460b-9bc4-de325b27eaf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:46.032052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed6019-0641-460b-9bc4-de325b27eaf5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:46.047623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 488/989] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:45 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:47.036455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb673-72fb-4cb9-8a34-7efff9843293 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.036942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb673-72fb-4cb9-8a34-7efff9843293 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.036942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb673-72fb-4cb9-8a34-7efff9843293 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.038726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 502/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:47.044080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.044493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.044707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.062078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:47.063389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:47.137440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 489/991] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:47.156411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb673-72fb-4cb9-8a34-7efff9843293 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:47.258376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb673-72fb-4cb9-8a34-7efff9843293 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:47.290547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:47.291272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.291609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.291853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.292496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:47.293879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:47.305109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 29 15:45:47.306421 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 503/992] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Mar 29 15:45:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:47.312049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:47.403289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a6dc2-c81c-4afc-a5b7-4d928ebb3317 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:47.434972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:47.435658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.435943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.436217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.436916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:47.437221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:47.438583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b101d-dec0-4621-8813-379ce64c3d66 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:47.448179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 490/993] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:47.449403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:47.543361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4d5de-fd68-41f9-afc2-2e94a6850691 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:47.566311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a614-33e1-43a6-a014-d1ae8e0d6a77 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.566586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a614-33e1-43a6-a014-d1ae8e0d6a77 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.566864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9a614-33e1-43a6-a014-d1ae8e0d6a77 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.568939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 491/994] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:47.573867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.574394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.574394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.575923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:47.576593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.576876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.577151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.577863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:47.578170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:47.579576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:47.585088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 504/995] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Mar 29 15:45:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:47.590848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:47.592296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:47.593465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:47.664497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 492/996] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:47.686103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7e760-aaf2-445a-bbe3-2a54e6e53e7b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:47.687071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:47.722124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:47.723067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.723356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.723665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.724888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:47.727343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:47.746774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 505/997] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:47.817913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1783-ac10-454a-a083-f5f1f3b82c2b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:47.859946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:47.860756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:47.861045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:47.861358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] PATH_INFO: `/v3/services/image` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:47.862518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:47.864070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:47.875512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 29 15:45:47.879711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 493/998] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Mar 29 15:45:47 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:47.883296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:47.985257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f106158-0cd5-4251-b6a6-ada128f36c9e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:48.020347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:48.021038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.021325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.021614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.022343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:48.022651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:48.024116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287063a-2363-48a0-a9ba-0e0b3c3102d3 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:48.029657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 506/999] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:48.035239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:48.132367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804584-0ba3-4556-9d26-b1b3a8eaedce None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:48.165443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:48.166117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.166402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.166679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.167387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] RBAC: Adding query filter params (type=image) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:48.167734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:48.169107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d7a4-f918-400c-836d-eb6a8ab5eb71 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:48.179813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 494/1000] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:48.379651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe3d7-9353-4ce0-ab7b-7522cbe1294c None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.380190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe3d7-9353-4ce0-ab7b-7522cbe1294c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.380190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe3d7-9353-4ce0-ab7b-7522cbe1294c None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.382140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 507/1001] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:48.387191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.387429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.387745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.404363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:48.405528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:48.472837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 495/1002] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:48.498383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe3d7-9353-4ce0-ab7b-7522cbe1294c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:48.598014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe3d7-9353-4ce0-ab7b-7522cbe1294c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:48.630235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:48.631020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.631312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.631613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] PATH_INFO: `/v3/services/compute` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.632262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:48.633649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:48.644879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 29 15:45:48.646201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 508/1003] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:48.651808 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:48.745610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a0e6a-38f5-4802-986d-5dc122f0db04 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:48.781734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:48.782399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.782680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.782951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.783674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:48.783978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:48.785332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:48.794433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 496/1004] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:48.795639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:48.892346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58991d5e-2217-4e2c-a539-a7b187dc3efd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:48.927171 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:48.927794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:48.928082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:48.928359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:48.929061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:48.929370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:48.930750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:48.940153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 509/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:48.942610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:49.038400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a52d-a57f-493e-8565-46f28e8f4090 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:49.070601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:49.071262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:49.071561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:49.071838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:49.072617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] RBAC: Adding query filter params (interface=public, service_id=4632ff2194c0401f8c48d2d9e74ebf29, region_id=RegionOne) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:49.072925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:49.074353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958429a-3392-4015-bc3a-c468c34d35a5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:49.079567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 497/1006] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:48 2022] GET /identity/v3/endpoints?service_id=4632ff2194c0401f8c48d2d9e74ebf29&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:49.084829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:49.181624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891667b-372b-4400-97cf-1e9233f80c87 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:49.214393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b63804-4812-4d7f-9ba0-bcfd701cd9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:49.215056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b63804-4812-4d7f-9ba0-bcfd701cd9b7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:49.215342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b63804-4812-4d7f-9ba0-bcfd701cd9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:49.215783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b63804-4812-4d7f-9ba0-bcfd701cd9b7 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:49.216474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b63804-4812-4d7f-9ba0-bcfd701cd9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:49.217842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b63804-4812-4d7f-9ba0-bcfd701cd9b7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:49.231847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 510/1007] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:49 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:45:50.076384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c427b-38b0-40ae-aa65-656759936642 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.076894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c427b-38b0-40ae-aa65-656759936642 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.076894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c427b-38b0-40ae-aa65-656759936642 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.078628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 498/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:50.083734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.084138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.084312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.101439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:50.102601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:50.169442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 511/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:50.194751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c427b-38b0-40ae-aa65-656759936642 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:50.290486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c427b-38b0-40ae-aa65-656759936642 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:50.325313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf50e4-c6e0-4a0b-9c8d-b2d035360cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:50.326375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf50e4-c6e0-4a0b-9c8d-b2d035360cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.326865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf50e4-c6e0-4a0b-9c8d-b2d035360cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.327310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf50e4-c6e0-4a0b-9c8d-b2d035360cc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.328662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf50e4-c6e0-4a0b-9c8d-b2d035360cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:50.330319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf50e4-c6e0-4a0b-9c8d-b2d035360cc9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:50.332510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 499/1010] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:50.338248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:50.437057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721d74a-0788-4dde-b8be-355507d158b8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:50.470155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe033b5-bfd0-4be8-994c-6baf9f409176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:50.470877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe033b5-bfd0-4be8-994c-6baf9f409176 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.471164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe033b5-bfd0-4be8-994c-6baf9f409176 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.471442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe033b5-bfd0-4be8-994c-6baf9f409176 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.472190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe033b5-bfd0-4be8-994c-6baf9f409176 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:50.473623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe033b5-bfd0-4be8-994c-6baf9f409176 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:50.500394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 512/1011] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:50 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:50.502746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7325da-fbc6-462c-b1f1-8818f55699a8 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.503033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7325da-fbc6-462c-b1f1-8818f55699a8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.503314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7325da-fbc6-462c-b1f1-8818f55699a8 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.505104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 500/1012] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:50.510781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c38c5-c5f3-43e9-bc17-8d26b0582281 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.511100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c38c5-c5f3-43e9-bc17-8d26b0582281 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.511354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c38c5-c5f3-43e9-bc17-8d26b0582281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.529925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-bd5c38c5-c5f3-43e9-bc17-8d26b0582281 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:50.531142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bd5c38c5-c5f3-43e9-bc17-8d26b0582281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:50.603082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 513/1013] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:50.625891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7325da-fbc6-462c-b1f1-8818f55699a8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:50.729474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7325da-fbc6-462c-b1f1-8818f55699a8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:50.763970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488bf24-914d-416d-a31f-a0f5d78d46d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:50.764716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488bf24-914d-416d-a31f-a0f5d78d46d4 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:50.764903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488bf24-914d-416d-a31f-a0f5d78d46d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:50.765172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488bf24-914d-416d-a31f-a0f5d78d46d4 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:50.765922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488bf24-914d-416d-a31f-a0f5d78d46d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:50.767329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488bf24-914d-416d-a31f-a0f5d78d46d4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:50.787637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 501/1014] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:45:50 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:51.548486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f762-d4a3-49fe-b7e9-1a0f9f4425b3 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:51.549103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f762-d4a3-49fe-b7e9-1a0f9f4425b3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:51.549103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971f762-d4a3-49fe-b7e9-1a0f9f4425b3 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:51.551065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 514/1015] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:51.556241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:51.556665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:51.556791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:51.574604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:51.575835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:51.651564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 502/1016] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:51.672792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f762-d4a3-49fe-b7e9-1a0f9f4425b3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:51.775434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971f762-d4a3-49fe-b7e9-1a0f9f4425b3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:51.808911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:51.809631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:51.809914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:51.810206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:51.810842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:51.812257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:51.823367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 29 15:45:51.824718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 515/1017] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:51.830477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:51.925717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa1675-109b-400e-9c32-06cfeacd71ed None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:51.958918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:51.959621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:51.959923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:51.960188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:51.961152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:51.961462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:51.962822 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:51.972610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 503/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:51.973613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:52.068194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c026107-06a4-471f-957e-f51b90123a56 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:52.100692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:52.101356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:52.101639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:52.101913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:52.102613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:52.102920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:52.104318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99f5e-b099-4825-a137-e747e70c1f55 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:52.109214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 516/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Mar 29 15:45:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:52.115216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:52.207829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6b20-ed7e-4d53-b96e-42c1faf84167 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:52.240241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217f751-5ea7-4eea-87a8-e245c3b0590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:52.240907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217f751-5ea7-4eea-87a8-e245c3b0590f None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:52.241196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217f751-5ea7-4eea-87a8-e245c3b0590f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:52.241475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217f751-5ea7-4eea-87a8-e245c3b0590f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:52.242228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217f751-5ea7-4eea-87a8-e245c3b0590f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:52.243618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217f751-5ea7-4eea-87a8-e245c3b0590f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:52.267843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 504/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:45:52.857284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf3e9f-b6e3-4260-9254-9b348539941f None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:52.857792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf3e9f-b6e3-4260-9254-9b348539941f None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:52.857868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf3e9f-b6e3-4260-9254-9b348539941f None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:52.859677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 517/1021] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:52.865004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9ea3-1221-406f-a29f-727741a7b914 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:52.865716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9ea3-1221-406f-a29f-727741a7b914 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:52.865716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded9ea3-1221-406f-a29f-727741a7b914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:52.883100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9ded9ea3-1221-406f-a29f-727741a7b914 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:52.884309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9ded9ea3-1221-406f-a29f-727741a7b914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:52.959547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 505/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:52.979788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf3e9f-b6e3-4260-9254-9b348539941f None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.075952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf3e9f-b6e3-4260-9254-9b348539941f None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.082636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479cc5-4519-46ec-bb7e-42152d6b1219 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.082923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479cc5-4519-46ec-bb7e-42152d6b1219 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.083200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479cc5-4519-46ec-bb7e-42152d6b1219 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.085120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 506/1023] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:53.089908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.090214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.090478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.106899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:53.108101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:53.109210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.110005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.110289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.110566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.112306 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.113755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.115615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 518/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:53.120922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.175241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 507/1025] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:53.197155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.216378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189f0c-6432-49f3-92b7-96dfe178c0b1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.249400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.250323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.250610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.250885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.251763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.253205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.275404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 519/1026] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:45:53 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:45:53.306432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1eea0-de96-46fc-a65a-07cb03975f39 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.342603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.343335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.343657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.343935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] PATH_INFO: `/v3/services/image` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.344600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.346028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.357412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 29 15:45:53.358852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 508/1027] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Mar 29 15:45:53 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:53.365376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.468423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eeb244-ef0f-498a-a1b1-b9e8c929c3aa None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.508768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.510008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.510548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.512938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.514180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] RBAC: Adding query filter params (name=image) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:53.514640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.516916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.523751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 520/1028] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:53.529478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.628873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda31b6e-af94-43b6-a7b2-7a38bc265f71 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.659860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.660523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.660802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.661076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.661774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] RBAC: Adding query filter params (type=image) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:53.662075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.663440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.674982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 509/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:53.675127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.773575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabba5a-5c1b-4745-9822-6c9774eb4680 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.805961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.806617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.806901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.807179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.808270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] RBAC: Adding query filter params (interface=public, service_id=6497c1827d2a44c5986bca90b93f00c5, region_id=RegionOne) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:53.808588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.810662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8ef2-fd38-476f-8e9c-80692c376038 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.819905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 521/1030] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:45:53 2022] GET /identity/v3/endpoints?service_id=6497c1827d2a44c5986bca90b93f00c5&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:53.825595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:53.924572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95ad68-ce03-48ae-bacc-a31e768b21ce None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:53.957096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaab3c4-e75a-4d4f-9826-a8c75cba4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:53.957762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab3c4-e75a-4d4f-9826-a8c75cba4e83 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:53.958053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab3c4-e75a-4d4f-9826-a8c75cba4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:53.958378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaab3c4-e75a-4d4f-9826-a8c75cba4e83 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:53.959067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaab3c4-e75a-4d4f-9826-a8c75cba4e83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:53.960713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaab3c4-e75a-4d4f-9826-a8c75cba4e83 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:53.971617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 510/1031] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:45:53 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:45:54.705835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574f4af-ff13-49c6-9e39-c71755e18c7e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:54.706384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574f4af-ff13-49c6-9e39-c71755e18c7e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:54.706384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574f4af-ff13-49c6-9e39-c71755e18c7e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:54.708258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 522/1032] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:54.713753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:54.714052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:54.714334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:54.734658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:54.736398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:54.813841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 511/1033] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:54.837650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574f4af-ff13-49c6-9e39-c71755e18c7e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:54.940698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574f4af-ff13-49c6-9e39-c71755e18c7e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:54.974267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:54.974999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:54.975281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:54.975578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:54.985967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:54.993362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 15:45:55.000715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 523/1034] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Mar 29 15:45:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:55.002808 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.099373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b62ec-fc79-408d-92e1-31fb37fa0698 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.132414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.133087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.133369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.133645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.134394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:55.134698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:55.136104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:55.148681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 512/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:55.150468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.248850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0733-a129-4ec6-9069-54df9b937c7c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.281760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.282556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.283353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.283651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.293210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:55.294668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:55.310821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:55.317170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 524/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:55.318873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.417142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb99b5-d3af-47cd-8d84-deb8938a3606 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.448545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.449205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.449491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.449767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.450484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:55.450790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:55.452187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:55.468659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 513/1037] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:55.471055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.565197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4a48d-5b95-4330-adb7-d794b98d0ece None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.598568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.599362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.599688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.599968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] PATH_INFO: `/v3/users/nova` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.607313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:55.608787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:55.622237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-15d8c9ff-570e-4c4a-b95e-e38724dde38c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:45:55.623610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 525/1038] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:55.629122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.692282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629cd5c-eb0c-423f-91a2-178db2ba9b89 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.692597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629cd5c-eb0c-423f-91a2-178db2ba9b89 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.692852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629cd5c-eb0c-423f-91a2-178db2ba9b89 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.694848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 526/1039] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:55.699491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.699809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.700085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.717046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:55.718212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:55.725428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8ee6e-4fa1-4d38-8e11-40749f5db9a1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.759157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.759853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.760134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.760407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.761245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:55.761536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:55.763025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:55.783569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 514/1040] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:55.785684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.796646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 527/1041] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:55.820328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.890529 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4bf3-9826-4d28-b45b-0433137cbb68 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.919762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700e1de-a0e7-4146-a65a-b666511429f4 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:55.924331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.924989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.925273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.925633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.960060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:55.961104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:55.961383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:55.961651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:55.971660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:55.978429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:55.979651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 528/1042] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:55.985267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:55.996084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:55.997547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.084449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f819026-8c8f-40a0-9a65-50175fa1917f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.109969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 515/1043] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 15:45:56.111709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.117899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.118595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.118880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.119159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.119939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:56.120248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.121635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.129794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 529/1044] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:56.135308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.208001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ded94-9b77-4e3f-915d-246900f0584b None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.230401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c8043-7df3-4b33-a2f6-d0ee3ccffc07 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.240823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.241789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.242238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.242662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.252648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.254158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.263162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.264041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.264324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.264599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] PATH_INFO: `/v3/users/bb9672c72d2d4521939659118134f16c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.271211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:56.272673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 516/1045] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:56.278091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.278226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] RBAC: Authorizing `identity:get_user(user_id=bb9672c72d2d4521939659118134f16c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.279643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.286172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 530/1046] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/users/bb9672c72d2d4521939659118134f16c => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:56.286811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.380185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231b00-d74d-43e8-acb1-8300e0b93d59 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.381226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfc6a4-3bb4-40ed-bc77-8fdc003a8e84 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.414533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.415490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.415985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.416110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782db68f-5217-4ba6-a6bc-8cf2cc50869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.416567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.416754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db68f-5217-4ba6-a6bc-8cf2cc50869b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.417039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db68f-5217-4ba6-a6bc-8cf2cc50869b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.417313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782db68f-5217-4ba6-a6bc-8cf2cc50869b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.418062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:56.418550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.420179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c813dc6-0034-4995-a530-33ee72f88420 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.431846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 517/1047] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:56.436974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392ac8a-a426-4a94-b36c-355fd8cfbd4b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.437270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392ac8a-a426-4a94-b36c-355fd8cfbd4b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.437550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392ac8a-a426-4a94-b36c-355fd8cfbd4b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.439297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 518/1048] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:56.440033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392ac8a-a426-4a94-b36c-355fd8cfbd4b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.481731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782db68f-5217-4ba6-a6bc-8cf2cc50869b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.483190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782db68f-5217-4ba6-a6bc-8cf2cc50869b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.536113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392ac8a-a426-4a94-b36c-355fd8cfbd4b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.567093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.567914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.568197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.568471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.572945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 531/1049] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 15:45:56.574059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.574345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.574618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.575226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.576708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.590823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:45:56.591750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:56.592020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 519/1050] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:56.592782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.592911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:56.655685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 532/1051] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:56.656442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.685614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3005ef-27b9-4de0-99d8-e7cad902dd5e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.718490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.719346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.719661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.719964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.721140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] RBAC: Authorizing `identity:get_project(project_id=6edd5f0f743541e8a7e711f6bed0af8c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.722566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.724258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 520/1052] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:56.725013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.749887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7ded-cb2b-4442-9576-f28da4ee5ff0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.783846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.784500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.784778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.785047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.785825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:56.786149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.787602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.799763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 533/1053] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:56.800626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.826062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d050cc9-88e8-4e52-bf4b-66f57db03313 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.865271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.866061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.866348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.866624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] PATH_INFO: `/v3/services/image` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.867274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.868688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.880899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 29 15:45:56.882282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 521/1054] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:56.883118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.895280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9725d-e4c4-4cf5-bbc3-54395b916fad None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:56.927767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:56.928354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:56.928640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:56.928917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:56.929738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c, user.id=bb9672c72d2d4521939659118134f16c) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:56.930050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:56.931476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:56.936671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 534/1055] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/role_assignments?user.id=bb9672c72d2d4521939659118134f16c&scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:56.937436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:56.983966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0e2cf-dd69-442c-a838-99f977a31b46 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:57.018913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:57.019628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:57.019918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:57.020198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:57.021271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] RBAC: Adding query filter params (role.id=cfdc67df5250453ea019be9606758506, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=ba546b8ade2443a096e7f303d609b622) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:57.021387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:57.022821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:57.028885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 522/1056] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/role_assignments?user.id=ba546b8ade2443a096e7f303d609b622&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=cfdc67df5250453ea019be9606758506 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:57.053590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a3d51-e9da-4772-8dcb-cbe7f328fa32 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:57.091839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:57.092552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:57.092839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:57.093117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:57.093875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] RBAC: Adding query filter params (name=image) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:57.094192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:57.096274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:57.106869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 535/1057] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:45:57.108706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:57.211312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768aa29b-128a-4eb0-9e44-e8ca5d7aa10e None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:57.244413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:57.245079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:57.245362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:57.245643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:57.246350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:57.246658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:57.248178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f48ef-8105-49b8-a76b-cdb1caf733b8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:57.253648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 523/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:57.259322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:57.354400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26afb76-8e9d-4af4-a13d-f679e6509deb None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:57.386745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add356ac-f39e-4cae-935d-6401baf68fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:57.387400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add356ac-f39e-4cae-935d-6401baf68fe4 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:57.387723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add356ac-f39e-4cae-935d-6401baf68fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:57.388001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add356ac-f39e-4cae-935d-6401baf68fe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:57.388744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add356ac-f39e-4cae-935d-6401baf68fe4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:57.390107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add356ac-f39e-4cae-935d-6401baf68fe4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:57.418882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 536/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:45:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:45:59.216893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38379552-e6df-4413-9b3e-681cfb439244 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.217382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38379552-e6df-4413-9b3e-681cfb439244 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.217382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38379552-e6df-4413-9b3e-681cfb439244 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.219116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 524/1060] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:59.224840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8980a2-6bca-474c-b91d-b0678beebd06 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.225248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8980a2-6bca-474c-b91d-b0678beebd06 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.225410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8980a2-6bca-474c-b91d-b0678beebd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.242381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-dd8980a2-6bca-474c-b91d-b0678beebd06 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:59.243586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-dd8980a2-6bca-474c-b91d-b0678beebd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:59.313065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 537/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:45:59.336332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38379552-e6df-4413-9b3e-681cfb439244 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.348385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f233b-c112-44fe-abc1-319931227002 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.348666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f233b-c112-44fe-abc1-319931227002 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.348954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f233b-c112-44fe-abc1-319931227002 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.350730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 538/1062] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:45:59.355725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.356013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.356289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.375292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:59.377251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:59.439987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38379552-e6df-4413-9b3e-681cfb439244 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.455591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 539/1063] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:45:59.478474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.479269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.479567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.479847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.482480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.491659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:59.498783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:45:59.505392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 525/1064] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:45:59.506429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.587032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c653c-0fd2-4d2a-8c53-e985c74e15e0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.602055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6ba1-7681-4f83-aae2-00a9a0a682b6 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.625899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.626734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.627012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.627284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.635242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.635935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.636221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.636505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.637201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:45:59.637304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:59.637557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:59.638914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:59.644608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 15:45:59.647622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 540/1065] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:59.647751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 526/1066] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:59.651698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.653300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.748620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ab34c-d6f1-4046-ad08-6adbcbded5e3 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.752883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a31396-d740-42e4-8bdd-2e27cc7f97d9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.780654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.781321 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.781602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.781877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.783152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:45:59.783456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:59.784597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aec012-be20-41a6-af7f-69e3fa46de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.784875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:59.785468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec012-be20-41a6-af7f-69e3fa46de33 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.785747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec012-be20-41a6-af7f-69e3fa46de33 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.786019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aec012-be20-41a6-af7f-69e3fa46de33 None admin] PATH_INFO: `/v3/users/bb9672c72d2d4521939659118134f16c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.787233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aec012-be20-41a6-af7f-69e3fa46de33 None admin] RBAC: Authorizing `identity:get_user(user_id=bb9672c72d2d4521939659118134f16c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:59.788683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aec012-be20-41a6-af7f-69e3fa46de33 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:59.790287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 527/1067] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/users/bb9672c72d2d4521939659118134f16c => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:59.791443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818d0c-02fb-4b1f-8498-9285f4b7c02b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.791914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818d0c-02fb-4b1f-8498-9285f4b7c02b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.792358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818d0c-02fb-4b1f-8498-9285f4b7c02b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.793682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 541/1068] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:59.794263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 528/1069] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:45:59.796284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.799590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23818d0c-02fb-4b1f-8498-9285f4b7c02b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:45:59.888930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5447f9-d64d-4bd8-9d1d-084452879cf2 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.893575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23818d0c-02fb-4b1f-8498-9285f4b7c02b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:45:59.921104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab244d9a-d97c-4d24-8094-0cbcbeb2e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.921960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab244d9a-d97c-4d24-8094-0cbcbeb2e6ae None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.922240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab244d9a-d97c-4d24-8094-0cbcbeb2e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.922514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab244d9a-d97c-4d24-8094-0cbcbeb2e6ae None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.924283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab244d9a-d97c-4d24-8094-0cbcbeb2e6ae None admin] RBAC: Authorizing `identity:get_project(project_id=6edd5f0f743541e8a7e711f6bed0af8c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:59.925930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab244d9a-d97c-4d24-8094-0cbcbeb2e6ae None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:59.926234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:45:59.927120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.927461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.928019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.928137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 542/1070] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:45:59.929156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:45:59.929567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:45:59.929853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:45:59.940739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:45:59.942459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:45:59.950775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:45:59.952032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:45:59.960836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:45:59.962042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 529/1071] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:45:59.962805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.018762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 543/1072] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:45:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:00.019556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.057515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453ecc-dee9-4139-bac5-8b7aca92fbdd None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.089318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.090192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.090472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.090746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c/users/bb9672c72d2d4521939659118134f16c/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.092726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] RBAC: Authorizing `identity:create_grant(project_id=6edd5f0f743541e8a7e711f6bed0af8c, user_id=bb9672c72d2d4521939659118134f16c, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.094161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.107366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 530/1073] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:45:59 2022] PUT /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c/users/bb9672c72d2d4521939659118134f16c/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:46:00.108209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.116425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ecbf8-f835-40b7-8bdf-72f816e9be97 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.153815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.154492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.154781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.155058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.155825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:00.156135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.157570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.169466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 544/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:00.175899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.217190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34713-3a83-4d89-be64-dfb68e03ee5f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.252422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.253387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.253847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.254351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.281673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afffd7-c10e-40f4-9412-21dcfb70202a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.318544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.319343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.319779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.319967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.326673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.328246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.328468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.329894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.343444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:46:00.345366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 545/1075] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:46:00.350739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.425695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 531/1076] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:00.431288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.452904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67b34d-0697-486f-a6cb-5efd4a5765e5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.487206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.488070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.488359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.488942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.490049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:00.490361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.492530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.514945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 546/1077] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:00.516099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.534195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4e9fb-ef26-4e70-878b-7f6647c1dec0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.566584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.567372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.567690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.567970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.577633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.579129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.596259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:46:00.597603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 532/1078] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:46:00.603096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.617928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce3f3-71ea-4162-aae9-38766ce563d4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.652442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.653657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.654103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.654386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.664968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.666436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.684674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:46:00.685872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 547/1079] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:00.691501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.702213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee182-ff52-41f4-849c-f0a727d480a7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.738605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.739262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.739577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.739837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.740552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:00.740855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.742210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.763684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 533/1080] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:00.797676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd17f6d-7314-4209-a947-45d8e4f99475 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.835407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.836105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.836385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.836657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:00.837384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:00.837688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:00.839075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:00.851644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 548/1081] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:00.857885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:00.960435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4580d-fe8e-49be-9e7a-394e79ff5c37 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:00.995588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:00.996387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:00.996666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:00.996938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:01.008891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:01.010217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:01.024222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:46:01.025736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 534/1082] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:46:01.031482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:01.130954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1e95a-d1ce-40a1-b604-090b37974e87 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:01.162617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:01.163275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:01.163588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:01.163868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:01.164646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:01.164958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:01.166402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b1dd9-a252-490b-8871-ef5880a328bc None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:01.178461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 549/1083] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:01.184342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:01.280837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb58b-c353-4fe1-a40a-a62e40fd9ca1 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:01.312622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453520cd-a894-4855-be1b-a0ff2aa986cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:01.314011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453520cd-a894-4855-be1b-a0ff2aa986cc None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:01.314293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453520cd-a894-4855-be1b-a0ff2aa986cc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:01.314566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453520cd-a894-4855-be1b-a0ff2aa986cc None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/ba546b8ade2443a096e7f303d609b622/roles/cfdc67df5250453ea019be9606758506` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:01.316762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453520cd-a894-4855-be1b-a0ff2aa986cc None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=ba546b8ade2443a096e7f303d609b622, role_id=cfdc67df5250453ea019be9606758506)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:01.318185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453520cd-a894-4855-be1b-a0ff2aa986cc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:01.330695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 535/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:46:01 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/ba546b8ade2443a096e7f303d609b622/roles/cfdc67df5250453ea019be9606758506 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:46:02.402644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bb0-c228-48b0-921e-e044382bcd18 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:02.403221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bb0-c228-48b0-921e-e044382bcd18 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:02.403221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bb0-c228-48b0-921e-e044382bcd18 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:02.404988 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 550/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:02.410775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:02.411223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:02.411324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:02.428723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:02.429936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:02.493617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 536/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:02.517998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55bb0-c228-48b0-921e-e044382bcd18 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:02.613832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55bb0-c228-48b0-921e-e044382bcd18 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:02.645248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:02.646031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:02.646315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:02.646591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:02.656184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:02.663494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:02.664681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 551/1087] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:02.670618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:02.762268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a0129-c08c-4a75-b864-95282dc69167 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:02.794171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:02.794828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:02.795108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:02.795383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:02.796149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:02.796458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:02.798333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:02.806168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 537/1088] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:02.811767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:02.906929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e32a9-4091-48d8-b144-db25d5230977 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:02.939303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:02.940218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:02.940508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:02.940777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] PATH_INFO: `/v3/users/bb9672c72d2d4521939659118134f16c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:02.941992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] RBAC: Authorizing `identity:get_user(user_id=bb9672c72d2d4521939659118134f16c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:02.943447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:02.945088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 552/1089] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:02 2022] GET /identity/v3/users/bb9672c72d2d4521939659118134f16c => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:02.951355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:03.046055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8a67-90af-44fa-8402-ad5d7cfd9d31 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:03.077079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:03.077717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:03.078000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:03.078275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:03.142038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:03.143480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:03.235561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 538/1090] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 15:46:03.241712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:03.336874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344b3b-34b5-4b0b-b8b9-a7c79b5a41b4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:03.372835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2bbe9-1dfc-42a7-93d1-ec4ec13cca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:03.373697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bbe9-1dfc-42a7-93d1-ec4ec13cca1e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:03.374106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bbe9-1dfc-42a7-93d1-ec4ec13cca1e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:03.374617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2bbe9-1dfc-42a7-93d1-ec4ec13cca1e None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:03.377183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2bbe9-1dfc-42a7-93d1-ec4ec13cca1e None admin] RBAC: Authorizing `identity:get_project(project_id=6edd5f0f743541e8a7e711f6bed0af8c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:03.378877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2bbe9-1dfc-42a7-93d1-ec4ec13cca1e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:03.382173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 553/1091] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:03 2022] GET /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:03.388037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:03.480846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c5ee-bd23-410a-8fd9-d964a9955deb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:03.513748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:03.514327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:03.514611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:03.514889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:03.515744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c, user.id=bb9672c72d2d4521939659118134f16c) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:03.516057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:03.518038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c26a9-647f-4fd0-9d40-298fd004e3f7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:03.523763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 539/1092] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:03 2022] GET /identity/v3/role_assignments?user.id=bb9672c72d2d4521939659118134f16c&scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:03.593206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f37e-f3ca-4dff-bd9b-1c87e91cd34a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:03.593758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f37e-f3ca-4dff-bd9b-1c87e91cd34a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:03.593758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6f37e-f3ca-4dff-bd9b-1c87e91cd34a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:03.596136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 554/1093] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:46:03.602159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:03.602459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:03.602742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:03.620163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:03.621373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:03.689877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 540/1094] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:03.714304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f37e-f3ca-4dff-bd9b-1c87e91cd34a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:03.817801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6f37e-f3ca-4dff-bd9b-1c87e91cd34a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:03.850527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:03.851331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:03.851649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:03.851926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:03.862008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:03.869376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 29 15:46:03.870566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 555/1095] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Mar 29 15:46:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:03.876820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:03.974630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46bac0-872d-4463-a207-ad231b60885a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:04.007894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:04.008809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:04.009094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:04.012849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:04.012849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:04.012849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:04.012849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:04.021097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 541/1096] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:46:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:04.027849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:04.120699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4c1ca-fb68-4b3c-9d61-6fdd3d9a60ab None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:04.152310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:04.153087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:04.153367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:04.153637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:04.162871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:04.164344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:04.180288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:46:04.181442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 556/1097] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:04.187216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:04.280014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58d325-fc8f-4bb6-babd-c0fa30889e85 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:04.310996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:04.311674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:04.311956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:04.312226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:04.312935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:04.313750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:04.315112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:04.325898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 542/1098] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:04.332005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:04.426361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac332e6-825c-40a8-8eab-a0cfc67749fa None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:04.460105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:04.460885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:04.461166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:04.461437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:04.468088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:04.469560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:04.483063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 29 15:46:04.484247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 557/1099] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Mar 29 15:46:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:04.490435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:04.590474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44a85-2dc4-46c1-9070-ef057ecffe08 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:04.622286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:04.622949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:04.623236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:04.623513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:04.624369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:04.624681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:04.626660 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:04.643538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 543/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Mar 29 15:46:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:04.649167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:04.745192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4c1f-4848-4e9a-9368-9d14754ec4ca None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:04.777100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:04.777745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:04.778033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:04.778312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:04.841528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:04.843026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:04.933935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 558/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 15:46:04.939699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:05.035830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f85df-1a88-4a40-877e-7fbab1fbe535 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:05.067432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:05.068245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.068532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.068852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.078335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:05.080361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:05.097630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:46:05.098950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 544/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:46:05.104735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:05.197289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee2d2d-3b92-4509-b925-b1d110de8ffd None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:05.228736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:05.229398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.229681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.229958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.230674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:05.230982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:05.232372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:05.243568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 559/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:05.249356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:05.344413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a19fdd-ace7-41b5-9dc1-ccd0272841c3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:05.377182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:05.377975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.378262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.378543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.385022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:05.386470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:05.399231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:46:05.400457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 545/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:05.406342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:05.503307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76f42b-cb77-4528-a359-13a0fd70fe1d None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:05.538407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:05.539068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.539354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.539670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.540454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:05.540764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:05.542211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643268f0-9988-4539-ab5e-2ea483535592 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:05.555082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 560/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:05.561018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:05.654145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f5e47-0770-4861-b9f4-3029167acc13 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:05.685941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:05.686584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.686863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.687136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.687990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] RBAC: Adding query filter params (role.id=cfdc67df5250453ea019be9606758506, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=ba546b8ade2443a096e7f303d609b622) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:05.688337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:05.689754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fadec1-c169-4397-9426-5ff5c3a7dcf1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:05.695274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 546/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:05 2022] GET /identity/v3/role_assignments?user.id=ba546b8ade2443a096e7f303d609b622&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=cfdc67df5250453ea019be9606758506 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:05.875009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab130-aa20-4908-a866-b813405fc830 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.875585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab130-aa20-4908-a866-b813405fc830 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.875684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab130-aa20-4908-a866-b813405fc830 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.877402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 561/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:05.882581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:05.882936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:05.883283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:05.900462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:05.901625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:05.967363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 547/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:05.992956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab130-aa20-4908-a866-b813405fc830 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:06.093170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab130-aa20-4908-a866-b813405fc830 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:06.127170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd882ba6-a15a-468a-958b-9b7e67c2b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:06.128007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd882ba6-a15a-468a-958b-9b7e67c2b5ea None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:06.128294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd882ba6-a15a-468a-958b-9b7e67c2b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:06.128567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd882ba6-a15a-468a-958b-9b7e67c2b5ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:06.129765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd882ba6-a15a-468a-958b-9b7e67c2b5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:06.131216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd882ba6-a15a-468a-958b-9b7e67c2b5ea None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:06.132869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 562/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:06.138925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:06.234799 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eaef-a0ca-4c70-9338-3a01e63283fe None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:06.269820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475397a-2c60-4492-8278-e571ad50503b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:06.270498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475397a-2c60-4492-8278-e571ad50503b None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:06.270780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475397a-2c60-4492-8278-e571ad50503b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:06.271062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475397a-2c60-4492-8278-e571ad50503b None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:06.271807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475397a-2c60-4492-8278-e571ad50503b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:06.273242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475397a-2c60-4492-8278-e571ad50503b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:06.293904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 548/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:46:06 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:46:08.629274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c57fe-a77e-4dec-af37-83bde444148a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:08.629824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c57fe-a77e-4dec-af37-83bde444148a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:08.629824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c57fe-a77e-4dec-af37-83bde444148a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:08.631639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 563/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:08.636653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:08.637078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:08.637217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:08.653608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:08.654782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:08.716732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 549/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:08.741713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c57fe-a77e-4dec-af37-83bde444148a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:08.837309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c57fe-a77e-4dec-af37-83bde444148a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:08.868724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:08.869569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:08.869853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:08.870132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] PATH_INFO: `/v3/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:08.871612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] RBAC: Authorizing `identity:get_role(role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:08.872992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:08.874334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 564/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:08 2022] GET /identity/v3/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:08.883048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:08.974591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db9aa0-647f-422f-bad9-838244437aed None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:09.005890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:09.006778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:09.007058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:09.007324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] PATH_INFO: `/v3/users/8c9a96a865ce406d978c10b4cd13a585` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:09.020641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c9a96a865ce406d978c10b4cd13a585)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:09.022074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:09.023764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 550/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:08 2022] GET /identity/v3/users/8c9a96a865ce406d978c10b4cd13a585 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:09.029570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:09.122743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc1d65-9034-4b72-8b9c-53df8cf38cc3 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:09.154621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:09.155200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:09.155485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:09.155795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:09.218053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:09.220085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:09.310101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 565/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:09.316515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:09.409981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20735-9b09-402d-90b3-3056e4e0ced2 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:09.441234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f2463-e55c-4d13-a5f2-bca5bdee0ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:09.442088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2463-e55c-4d13-a5f2-bca5bdee0ec1 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:09.442371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2463-e55c-4d13-a5f2-bca5bdee0ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:09.442647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f2463-e55c-4d13-a5f2-bca5bdee0ec1 None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:09.443935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f2463-e55c-4d13-a5f2-bca5bdee0ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=6edd5f0f743541e8a7e711f6bed0af8c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:09.445296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f2463-e55c-4d13-a5f2-bca5bdee0ec1 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:09.446955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 551/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:09 2022] GET /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:09.454123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:09.548419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9c2b-4869-4885-bf64-c9faf59701e5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:09.580181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:09.580819 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:09.581100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:09.581380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:09.582194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] RBAC: Adding query filter params (role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c, user.id=8c9a96a865ce406d978c10b4cd13a585) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:09.582504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:09.583971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af117e34-e672-4d80-b5fd-778c09badc46 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:09.589316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 566/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:09 2022] GET /identity/v3/role_assignments?user.id=8c9a96a865ce406d978c10b4cd13a585&scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:11.880600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391a343-4396-4c5a-94cb-404932fee468 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:11.881131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391a343-4396-4c5a-94cb-404932fee468 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:11.881223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391a343-4396-4c5a-94cb-404932fee468 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:11.882919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 552/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:11.888186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:11.888572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:11.888750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:11.906271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:11.908053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:11.970108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 567/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:11.992945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391a343-4396-4c5a-94cb-404932fee468 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:12.087586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391a343-4396-4c5a-94cb-404932fee468 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:12.118880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:12.119748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:12.120034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:12.120310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] PATH_INFO: `/v3/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:12.121756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] RBAC: Authorizing `identity:get_role(role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:12.123122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:12.124490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 553/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:11 2022] GET /identity/v3/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:12.130814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:12.220225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e994-a6c9-4581-9f4d-e00f9600c387 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:12.251107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:12.251982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:12.252261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:12.252531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] PATH_INFO: `/v3/users/8c9a96a865ce406d978c10b4cd13a585` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:12.253683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] RBAC: Authorizing `identity:get_user(user_id=8c9a96a865ce406d978c10b4cd13a585)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:12.255099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:12.256694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 568/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:12 2022] GET /identity/v3/users/8c9a96a865ce406d978c10b4cd13a585 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:12.262289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:12.357691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20674-fe02-4caa-b347-04676b05cae5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:12.391934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b85d9-2b51-49ce-a150-cd97a0063b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:12.392800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b85d9-2b51-49ce-a150-cd97a0063b68 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:12.393091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b85d9-2b51-49ce-a150-cd97a0063b68 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:12.393370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b85d9-2b51-49ce-a150-cd97a0063b68 None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:12.394549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b85d9-2b51-49ce-a150-cd97a0063b68 None admin] RBAC: Authorizing `identity:get_project(project_id=6edd5f0f743541e8a7e711f6bed0af8c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:12.396021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b85d9-2b51-49ce-a150-cd97a0063b68 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:12.397703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 554/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:12 2022] GET /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:12.403837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:12.517382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7955d-3cee-4844-a418-1fb276f4c4fb None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:12.550578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259729b-9e53-4530-91dc-e900baf75c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:12.551459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259729b-9e53-4530-91dc-e900baf75c31 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:12.551765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259729b-9e53-4530-91dc-e900baf75c31 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:12.552038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259729b-9e53-4530-91dc-e900baf75c31 None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c/users/8c9a96a865ce406d978c10b4cd13a585/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:12.554167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259729b-9e53-4530-91dc-e900baf75c31 None admin] RBAC: Authorizing `identity:create_grant(project_id=6edd5f0f743541e8a7e711f6bed0af8c, user_id=8c9a96a865ce406d978c10b4cd13a585, role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:12.555615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259729b-9e53-4530-91dc-e900baf75c31 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:12.568869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 569/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:46:12 2022] PUT /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c/users/8c9a96a865ce406d978c10b4cd13a585/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:46:14.816335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9751c4-60df-4baa-b659-e651def8bdc4 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:14.816788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9751c4-60df-4baa-b659-e651def8bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:14.816901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9751c4-60df-4baa-b659-e651def8bdc4 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:14.818641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 555/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:14.823742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:14.824135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:14.824294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:14.841029 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:14.842178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:14.903609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 570/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:14.929300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9751c4-60df-4baa-b659-e651def8bdc4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:15.024252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9751c4-60df-4baa-b659-e651def8bdc4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:15.055638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:15.056474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:15.056758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:15.057039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] PATH_INFO: `/v3/roles/1d3f3d37721945aa8e0dd2cc576e9d04` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:15.058484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] RBAC: Authorizing `identity:get_role(role_id=1d3f3d37721945aa8e0dd2cc576e9d04)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:15.059872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:15.061201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 556/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:14 2022] GET /identity/v3/roles/1d3f3d37721945aa8e0dd2cc576e9d04 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:15.066877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:15.159680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea83658-cab5-4a9c-99c0-5f0fcd6caaa9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:15.190579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:15.191422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:15.191738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:15.192009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] PATH_INFO: `/v3/users/8c9a96a865ce406d978c10b4cd13a585` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:15.193161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] RBAC: Authorizing `identity:get_user(user_id=8c9a96a865ce406d978c10b4cd13a585)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:15.194587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:15.196202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 571/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:15 2022] GET /identity/v3/users/8c9a96a865ce406d978c10b4cd13a585 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:15.201910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:15.294646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf64bf-1e1e-4b11-8203-accedaed78c0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:15.326047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:15.326676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:15.326963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:15.327241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:15.391286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:15.392749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:15.481328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 557/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:15.487010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:15.578841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3144b7-5725-492d-80ec-37e5efae1249 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:15.610599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aee99-dcaa-4ab8-8631-d80fb5a428d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:15.611433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aee99-dcaa-4ab8-8631-d80fb5a428d2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:15.611744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aee99-dcaa-4ab8-8631-d80fb5a428d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:15.612022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aee99-dcaa-4ab8-8631-d80fb5a428d2 None admin] PATH_INFO: `/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:15.613188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aee99-dcaa-4ab8-8631-d80fb5a428d2 None admin] RBAC: Authorizing `identity:get_project(project_id=6edd5f0f743541e8a7e711f6bed0af8c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:15.614640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aee99-dcaa-4ab8-8631-d80fb5a428d2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:15.616336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 572/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:15 2022] GET /identity/v3/projects/6edd5f0f743541e8a7e711f6bed0af8c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:15.622461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:15.713983 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17a551-166b-4ca1-ae3d-eb6c49224bcb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:15.745641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:15.746286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:15.746569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:15.746847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:15.747699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] RBAC: Adding query filter params (role.id=1d3f3d37721945aa8e0dd2cc576e9d04, scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c, user.id=8c9a96a865ce406d978c10b4cd13a585) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:15.748016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:15.749436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee7798-044e-42cb-99b7-d47a66d2f935 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:15.755156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 558/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:15 2022] GET /identity/v3/role_assignments?user.id=8c9a96a865ce406d978c10b4cd13a585&scope.project.id=6edd5f0f743541e8a7e711f6bed0af8c&role.id=1d3f3d37721945aa8e0dd2cc576e9d04 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:18.022910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c70a7-b452-4685-900f-e7a98c113622 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:18.023420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c70a7-b452-4685-900f-e7a98c113622 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:18.023420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c70a7-b452-4685-900f-e7a98c113622 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:18.025209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 573/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:18.030220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:18.030602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:18.030774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:18.047416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:18.048596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:18.108949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 559/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:18.132365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c70a7-b452-4685-900f-e7a98c113622 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:18.228357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c70a7-b452-4685-900f-e7a98c113622 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:18.259692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c622b0-f3c9-4adb-99a5-768f9dee4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:18.260471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c622b0-f3c9-4adb-99a5-768f9dee4fec None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:18.260755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c622b0-f3c9-4adb-99a5-768f9dee4fec None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:18.261031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c622b0-f3c9-4adb-99a5-768f9dee4fec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:18.262192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c622b0-f3c9-4adb-99a5-768f9dee4fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:18.263657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c622b0-f3c9-4adb-99a5-768f9dee4fec None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:18.265238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 574/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:18.270976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:18.361501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d3d69-1dd6-4d4f-9223-1d59367375d8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:18.392491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca29641-ff34-40ba-8c60-e2f9ea7b1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:18.393127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca29641-ff34-40ba-8c60-e2f9ea7b1a77 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:18.393406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca29641-ff34-40ba-8c60-e2f9ea7b1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:18.393678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca29641-ff34-40ba-8c60-e2f9ea7b1a77 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:18.394368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca29641-ff34-40ba-8c60-e2f9ea7b1a77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:18.395794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca29641-ff34-40ba-8c60-e2f9ea7b1a77 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:18.420678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 560/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:46:18 2022] POST /identity/v3/projects => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:46:20.727322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9288-e154-447d-978b-58671226cd09 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:20.727882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9288-e154-447d-978b-58671226cd09 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:20.728017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9288-e154-447d-978b-58671226cd09 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:20.729682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 575/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:20.735459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:20.735848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:20.736058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:20.752457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:20.753628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:20.816031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 561/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:20.841502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9288-e154-447d-978b-58671226cd09 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:20.936065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9288-e154-447d-978b-58671226cd09 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:20.967421 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc498ade-2037-4d2f-abc1-4658cd36edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:20.968304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498ade-2037-4d2f-abc1-4658cd36edd3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:20.968690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498ade-2037-4d2f-abc1-4658cd36edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:20.968982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc498ade-2037-4d2f-abc1-4658cd36edd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:20.970203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc498ade-2037-4d2f-abc1-4658cd36edd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:20.971678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc498ade-2037-4d2f-abc1-4658cd36edd3 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:20.973288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 576/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:20.979236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:21.070697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c643c3-1b6b-4edb-acbe-30c248698c2e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:21.103428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd461b6-4ca5-410c-89a9-32ba82fc1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:21.104109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd461b6-4ca5-410c-89a9-32ba82fc1330 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:21.104390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd461b6-4ca5-410c-89a9-32ba82fc1330 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:21.104662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd461b6-4ca5-410c-89a9-32ba82fc1330 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:21.105363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd461b6-4ca5-410c-89a9-32ba82fc1330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:21.106789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd461b6-4ca5-410c-89a9-32ba82fc1330 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:21.125477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 562/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:46:20 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:46:23.423736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76edbe-edc8-4ebd-bb4b-fb341c41c681 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:23.424301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76edbe-edc8-4ebd-bb4b-fb341c41c681 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:23.424301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76edbe-edc8-4ebd-bb4b-fb341c41c681 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:23.426040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 577/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:23.431031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:23.431398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:23.431622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:23.448381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:23.449528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:23.510111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 563/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:23.533571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76edbe-edc8-4ebd-bb4b-fb341c41c681 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:23.626148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76edbe-edc8-4ebd-bb4b-fb341c41c681 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:23.656831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:23.657589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:23.657868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:23.658139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:23.667432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:23.674389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:23.675460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 578/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:23.681140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:23.773691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b4aa8-5801-45fb-90be-db7d335fb89b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:23.804253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:23.804902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:23.805181 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:23.805450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:23.806178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:23.806479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:23.807853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:23.815825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 564/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:23.821479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:23.915030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f99be1-76c3-4ccb-a21b-0710aae57d1c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:23.947185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:23.948016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:23.948304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:23.948583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] PATH_INFO: `/v3/users/56b5db2ab6ab4703a10a2f5b30ef5f14` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:23.961706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] RBAC: Authorizing `identity:get_user(user_id=56b5db2ab6ab4703a10a2f5b30ef5f14)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:23.963154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:23.964805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 579/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:23 2022] GET /identity/v3/users/56b5db2ab6ab4703a10a2f5b30ef5f14 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:23.970994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:24.064643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911eb686-2e9e-478c-a5f9-33d1abd6d893 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:24.095291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:24.095949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:24.096232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:24.096503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:24.157757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:24.159174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:24.248261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 565/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:24.256371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:24.348391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2b80c-7953-46c3-b057-283098876d19 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:24.380023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8911b-6055-45fd-80b7-8de7b0f956df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:24.380863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8911b-6055-45fd-80b7-8de7b0f956df None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:24.381143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8911b-6055-45fd-80b7-8de7b0f956df None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:24.381416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8911b-6055-45fd-80b7-8de7b0f956df None admin] PATH_INFO: `/v3/projects/de4ad385c1684d3682babc38164e6967` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:24.382558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8911b-6055-45fd-80b7-8de7b0f956df None admin] RBAC: Authorizing `identity:get_project(project_id=de4ad385c1684d3682babc38164e6967)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:24.384005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8911b-6055-45fd-80b7-8de7b0f956df None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:24.385635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 580/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:24 2022] GET /identity/v3/projects/de4ad385c1684d3682babc38164e6967 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:24.392092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:24.483619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cd524-ae8f-4b56-ab39-1512c9a7e9f3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:24.514860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:24.516022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:24.516307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:24.516582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:24.517393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=de4ad385c1684d3682babc38164e6967, user.id=56b5db2ab6ab4703a10a2f5b30ef5f14) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:24.517704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:24.519131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdd049-8355-4652-b45a-6de22d7bed62 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:24.524217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 566/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:24 2022] GET /identity/v3/role_assignments?user.id=56b5db2ab6ab4703a10a2f5b30ef5f14&scope.project.id=de4ad385c1684d3682babc38164e6967&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:26.766676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9e5f-c582-437b-8408-29464c48c20f None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:26.767125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9e5f-c582-437b-8408-29464c48c20f None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:26.767297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9e5f-c582-437b-8408-29464c48c20f None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:26.769125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 581/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:26.774369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:26.774770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:26.774927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:26.791931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:26.793093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:26.977314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 567/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:26.999793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9e5f-c582-437b-8408-29464c48c20f None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:27.097638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9e5f-c582-437b-8408-29464c48c20f None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:27.130254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:27.131030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:27.131314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:27.131617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:27.141345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:27.148255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:27.149432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 582/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:27.155376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:27.247086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25fdaf1-9a42-4865-b8f0-400f22b772ee None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:27.277896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:27.278549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:27.278831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:27.279109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:27.279890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:27.280196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:27.282044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:27.289550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 568/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:27.295325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:27.390313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149aa3-903c-4610-a2ff-cd4b8d924ae4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:27.420487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:27.421365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:27.421641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:27.421908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] PATH_INFO: `/v3/users/56b5db2ab6ab4703a10a2f5b30ef5f14` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:27.423058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] RBAC: Authorizing `identity:get_user(user_id=56b5db2ab6ab4703a10a2f5b30ef5f14)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:27.424523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:27.426103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 583/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:27 2022] GET /identity/v3/users/56b5db2ab6ab4703a10a2f5b30ef5f14 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:27.431986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:27.524286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e271f3b-269c-49b1-9d93-c32fbd9eab4f None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:27.555262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b21c38-089f-4f03-93a3-b9e413401319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:27.556125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21c38-089f-4f03-93a3-b9e413401319 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:27.556406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21c38-089f-4f03-93a3-b9e413401319 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:27.556678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b21c38-089f-4f03-93a3-b9e413401319 None admin] PATH_INFO: `/v3/projects/de4ad385c1684d3682babc38164e6967` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:27.557826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b21c38-089f-4f03-93a3-b9e413401319 None admin] RBAC: Authorizing `identity:get_project(project_id=de4ad385c1684d3682babc38164e6967)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:27.559247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b21c38-089f-4f03-93a3-b9e413401319 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:27.560924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 569/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:27 2022] GET /identity/v3/projects/de4ad385c1684d3682babc38164e6967 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:27.567122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:27.660131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605e08b-f043-4e14-9a7c-06db42289272 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:27.690488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f8709-d9cc-434b-a4b3-ffec86cacbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:27.691354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f8709-d9cc-434b-a4b3-ffec86cacbef None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:27.691677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f8709-d9cc-434b-a4b3-ffec86cacbef None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:27.691958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f8709-d9cc-434b-a4b3-ffec86cacbef None admin] PATH_INFO: `/v3/projects/de4ad385c1684d3682babc38164e6967/users/56b5db2ab6ab4703a10a2f5b30ef5f14/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:27.693886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f8709-d9cc-434b-a4b3-ffec86cacbef None admin] RBAC: Authorizing `identity:create_grant(project_id=de4ad385c1684d3682babc38164e6967, user_id=56b5db2ab6ab4703a10a2f5b30ef5f14, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:27.695311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f8709-d9cc-434b-a4b3-ffec86cacbef None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:27.709214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 584/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:46:27 2022] PUT /identity/v3/projects/de4ad385c1684d3682babc38164e6967/users/56b5db2ab6ab4703a10a2f5b30ef5f14/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:46:29.945004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc449-92b8-476e-8b8b-9bff1008927a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:29.945517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc449-92b8-476e-8b8b-9bff1008927a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:29.945517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc449-92b8-476e-8b8b-9bff1008927a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:29.947277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 570/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:29.952362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:29.952781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:29.952924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:29.969444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:29.970611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:30.032390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 585/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:30.055681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc449-92b8-476e-8b8b-9bff1008927a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:30.153723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc449-92b8-476e-8b8b-9bff1008927a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:30.184426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:30.185188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:30.185466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:30.185736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:30.195051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:30.201777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:30.203444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 571/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:30.209516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:30.301328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9078f99-104d-4ed9-bc32-dbe67a660dfd None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:30.333330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:30.334234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:30.334516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:30.334793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:30.335555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:30.335865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:30.337226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:30.345640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 586/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:30.351198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:30.443736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c43c8a-2e0e-46d5-8ce9-5f9082dc46e5 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:30.475061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:30.475918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:30.476199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:30.476469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] PATH_INFO: `/v3/users/56b5db2ab6ab4703a10a2f5b30ef5f14` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:30.477614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=56b5db2ab6ab4703a10a2f5b30ef5f14)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:30.479030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:30.480605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 572/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:30 2022] GET /identity/v3/users/56b5db2ab6ab4703a10a2f5b30ef5f14 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:30.486698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:30.578747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd85fe-8c00-41a0-a403-071be6290750 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:30.609985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:30.610611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:30.610896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:30.611170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:30.672904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:30.674352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:30.765666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 587/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:30.771560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:30.862378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5506a4-9459-4384-b639-a1350286c0a3 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:30.893170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d863b4-050e-4fad-b310-477134a45acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:30.894002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d863b4-050e-4fad-b310-477134a45acf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:30.894280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d863b4-050e-4fad-b310-477134a45acf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:30.894547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d863b4-050e-4fad-b310-477134a45acf None admin] PATH_INFO: `/v3/projects/de4ad385c1684d3682babc38164e6967` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:30.895709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d863b4-050e-4fad-b310-477134a45acf None admin] RBAC: Authorizing `identity:get_project(project_id=de4ad385c1684d3682babc38164e6967)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:30.897111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d863b4-050e-4fad-b310-477134a45acf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:30.898712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 573/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:30 2022] GET /identity/v3/projects/de4ad385c1684d3682babc38164e6967 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:30.904602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:30.995338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095eac1-66e9-4650-9855-463a06a86a3f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:31.026696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:31.027331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:31.027645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:31.027923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:31.028735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=de4ad385c1684d3682babc38164e6967, user.id=56b5db2ab6ab4703a10a2f5b30ef5f14) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:31.029046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:31.030987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690a8db-2c99-4a5c-94eb-e5e9984ee6dd None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:31.036431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 588/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:30 2022] GET /identity/v3/role_assignments?user.id=56b5db2ab6ab4703a10a2f5b30ef5f14&scope.project.id=de4ad385c1684d3682babc38164e6967&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:46:33.335392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a4d3-1fea-4d67-b735-07676c8bcac4 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:33.336013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a4d3-1fea-4d67-b735-07676c8bcac4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:33.336013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a4d3-1fea-4d67-b735-07676c8bcac4 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:33.337718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 574/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:33.343309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:33.343787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:33.343887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:33.360614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:33.361789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:33.423588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 589/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:46:33.446409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a4d3-1fea-4d67-b735-07676c8bcac4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:33.539578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a4d3-1fea-4d67-b735-07676c8bcac4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:33.570411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:33.571037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:33.571317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:33.571617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:33.635551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:33.636941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:33.727066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 575/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:33.733451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:33.824746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2367-9ac4-4eaf-99be-f33a4b39927c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:33.855948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:33.856735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:33.857015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:33.857285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:33.864141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:33.865570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:33.878931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-fe5b8460-457c-48aa-8e21-1274e9a1ac6b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 29 15:46:33.880089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 590/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:46:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:33.886043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:33.977434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aef7c-5236-41e2-bf3d-965b99a056bb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:34.008985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:34.009621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:34.009900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:34.010173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:34.010884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:34.011189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:34.012569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548084b-f2ac-4b77-ae6c-cbecb93d85c2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:34.019800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 576/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Mar 29 15:46:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:36.271042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bdfe6-1a35-42ae-896f-c3101d0669fa None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:36.271593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bdfe6-1a35-42ae-896f-c3101d0669fa None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:36.271593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bdfe6-1a35-42ae-896f-c3101d0669fa None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:36.273391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 591/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:36.278669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe5d1-fd16-4e2d-8fcf-8f09d525e70b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:36.279106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe5d1-fd16-4e2d-8fcf-8f09d525e70b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:36.279212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabe5d1-fd16-4e2d-8fcf-8f09d525e70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:36.296568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9eabe5d1-fd16-4e2d-8fcf-8f09d525e70b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:36.297724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9eabe5d1-fd16-4e2d-8fcf-8f09d525e70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:36.359943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 577/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:36.382660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bdfe6-1a35-42ae-896f-c3101d0669fa None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:36.477780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764bdfe6-1a35-42ae-896f-c3101d0669fa None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:36.508617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93a694-c8c7-452a-b134-f3a1d01b01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:36.509257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93a694-c8c7-452a-b134-f3a1d01b01d6 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:36.509540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93a694-c8c7-452a-b134-f3a1d01b01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:36.509813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93a694-c8c7-452a-b134-f3a1d01b01d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:36.510544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93a694-c8c7-452a-b134-f3a1d01b01d6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:36.511942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e93a694-c8c7-452a-b134-f3a1d01b01d6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:36.525851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 592/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue Mar 29 15:46:36 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:46:38.813925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4e035-7484-4c02-a2a9-7df61f55d0ec None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:38.814399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4e035-7484-4c02-a2a9-7df61f55d0ec None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:38.814491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4e035-7484-4c02-a2a9-7df61f55d0ec None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:38.816279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 578/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:38.821312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:38.821696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:38.821874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:38.838860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:38.840058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:38.902178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 593/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:38.925594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4e035-7484-4c02-a2a9-7df61f55d0ec None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:39.024012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4e035-7484-4c02-a2a9-7df61f55d0ec None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:39.055993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090e7aa-f3af-43a2-823e-185ad0a58a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:39.056840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090e7aa-f3af-43a2-823e-185ad0a58a80 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:39.057125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090e7aa-f3af-43a2-823e-185ad0a58a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:39.057403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090e7aa-f3af-43a2-823e-185ad0a58a80 None admin] PATH_INFO: `/v3/domains/913991645da94e2e9e57e1bbf1cdd207` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:39.067757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090e7aa-f3af-43a2-823e-185ad0a58a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=913991645da94e2e9e57e1bbf1cdd207)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:39.069186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090e7aa-f3af-43a2-823e-185ad0a58a80 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:39.070760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 579/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Mar 29 15:46:38 2022] GET /identity/v3/domains/913991645da94e2e9e57e1bbf1cdd207 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:39.076704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:39.167788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4aebb-2161-44a4-8760-a49d6b897dee None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:39.327183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1441-ce77-4df0-98d5-faf2dc748241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:39.327773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1441-ce77-4df0-98d5-faf2dc748241 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:39.328055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1441-ce77-4df0-98d5-faf2dc748241 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:39.328330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1441-ce77-4df0-98d5-faf2dc748241 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:39.329035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1441-ce77-4df0-98d5-faf2dc748241 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:39.330431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1441-ce77-4df0-98d5-faf2dc748241 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:39.354908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 594/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:46:39 2022] POST /identity/v3/projects => generated 361 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:46:41.648374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f33b-0c19-4ff8-8699-b96f8caa37f5 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:41.648924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f33b-0c19-4ff8-8699-b96f8caa37f5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:41.648924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438f33b-0c19-4ff8-8699-b96f8caa37f5 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:41.650677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 580/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:41.655696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:41.656134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:41.656237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:41.672320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:41.673483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:41.734918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 595/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:41.759854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f33b-0c19-4ff8-8699-b96f8caa37f5 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:41.859209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438f33b-0c19-4ff8-8699-b96f8caa37f5 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:41.890507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6035b25-50a7-4523-aac1-5c8c9cd1c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:41.891355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6035b25-50a7-4523-aac1-5c8c9cd1c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:41.891663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6035b25-50a7-4523-aac1-5c8c9cd1c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:41.891938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6035b25-50a7-4523-aac1-5c8c9cd1c7e2 None admin] PATH_INFO: `/v3/domains/913991645da94e2e9e57e1bbf1cdd207` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:41.893092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6035b25-50a7-4523-aac1-5c8c9cd1c7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=913991645da94e2e9e57e1bbf1cdd207)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:41.894520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6035b25-50a7-4523-aac1-5c8c9cd1c7e2 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:41.896126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 581/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Mar 29 15:46:41 2022] GET /identity/v3/domains/913991645da94e2e9e57e1bbf1cdd207 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:41.901898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:41.993762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e62ad-8b06-492b-be88-811bfcc6f42b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:42.025129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775ec1-3903-496f-8d7d-a19b5245f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:42.025785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775ec1-3903-496f-8d7d-a19b5245f8f1 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:42.026064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775ec1-3903-496f-8d7d-a19b5245f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:42.026335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775ec1-3903-496f-8d7d-a19b5245f8f1 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:42.027026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775ec1-3903-496f-8d7d-a19b5245f8f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:42.028479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775ec1-3903-496f-8d7d-a19b5245f8f1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:42.048028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 596/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:46:41 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:46:44.362135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee357b-4b63-42f3-bbc2-3d3add8ac90a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:44.362709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee357b-4b63-42f3-bbc2-3d3add8ac90a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:44.362709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee357b-4b63-42f3-bbc2-3d3add8ac90a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:44.364478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 582/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:44.369706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:44.370122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:44.370276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:44.386918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:44.388125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:44.449802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 597/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:44.473664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee357b-4b63-42f3-bbc2-3d3add8ac90a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:44.566337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee357b-4b63-42f3-bbc2-3d3add8ac90a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:44.600732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:44.601498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:44.601777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:44.602048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:44.612444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:44.619137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:44.620315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 583/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:44.626476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:44.718312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26241369-54b3-443f-9f93-819fa83c70ea None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:44.749238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:44.749886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:44.750167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:44.750439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:44.751178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:44.751482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:44.752876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:44.760645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 598/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:44.766407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:44.860686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f053b-e55d-48b1-97f6-22e16d0875eb None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:44.895654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:44.896433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:44.896710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:44.896987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] PATH_INFO: `/v3/users/ed2e224a053c44ac9553e797cf7f9c0d` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:44.909671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e224a053c44ac9553e797cf7f9c0d)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:44.911088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:44.912708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 584/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:44 2022] GET /identity/v3/users/ed2e224a053c44ac9553e797cf7f9c0d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:44.918519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:45.013113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012149-d736-440c-afa8-018c2ab521e7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:45.044887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:45.045522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:45.045812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:45.046094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:45.108910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:45.110338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:45.199950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 599/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:45.206226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:45.307721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7099f-18df-41d7-936b-ca0dc82c7a87 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:45.339676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b43de-964c-4a59-b9cc-253436c60a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:45.340520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b43de-964c-4a59-b9cc-253436c60a38 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:45.340804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b43de-964c-4a59-b9cc-253436c60a38 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:45.341077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b43de-964c-4a59-b9cc-253436c60a38 None admin] PATH_INFO: `/v3/projects/8853027ac96d4eeaad2d1a863bb41284` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:45.342314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b43de-964c-4a59-b9cc-253436c60a38 None admin] RBAC: Authorizing `identity:get_project(project_id=8853027ac96d4eeaad2d1a863bb41284)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:45.343784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b43de-964c-4a59-b9cc-253436c60a38 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:45.345432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 585/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:45 2022] GET /identity/v3/projects/8853027ac96d4eeaad2d1a863bb41284 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:45.351492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:45.442859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366a284-d99c-4195-8ee0-77fd9f83fe99 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:45.474058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:45.474632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:45.474912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:45.475185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:45.476039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=8853027ac96d4eeaad2d1a863bb41284, user.id=ed2e224a053c44ac9553e797cf7f9c0d) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:45.476343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:45.477750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f6015-c6a2-4151-a28d-a8073ea3372d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:45.482776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 600/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:45 2022] GET /identity/v3/role_assignments?user.id=ed2e224a053c44ac9553e797cf7f9c0d&scope.project.id=8853027ac96d4eeaad2d1a863bb41284&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:47.692488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393645b0-b8d4-4f7a-a9e8-0dbc6ea06855 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:47.693033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393645b0-b8d4-4f7a-a9e8-0dbc6ea06855 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:47.693033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393645b0-b8d4-4f7a-a9e8-0dbc6ea06855 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:47.694760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 586/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:47.699874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:47.700267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:47.700439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:47.717229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:47.718390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:47.780152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 601/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:47.802498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393645b0-b8d4-4f7a-a9e8-0dbc6ea06855 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:47.897049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393645b0-b8d4-4f7a-a9e8-0dbc6ea06855 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:47.928930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:47.929806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:47.930088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:47.930360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:47.939842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:47.946648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:47.947759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 587/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:47.954189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:48.045216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278ee80-1846-484d-9638-ce14371a5ee9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:48.075651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:48.076805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:48.077088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:48.077360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:48.078093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:48.078394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:48.079776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:48.087450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 602/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:48.093064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:48.184564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33969fe6-1c0c-4d54-a932-991360dd3741 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:48.215625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:48.216906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:48.217184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:48.217454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] PATH_INFO: `/v3/users/ed2e224a053c44ac9553e797cf7f9c0d` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:48.218606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e224a053c44ac9553e797cf7f9c0d)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:48.220130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:48.221676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 588/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:48 2022] GET /identity/v3/users/ed2e224a053c44ac9553e797cf7f9c0d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:48.227144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:48.318995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d53484-fae0-443d-b9ed-a69facde672f None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:48.349833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352102d8-7717-479f-a7aa-437fb4ada2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:48.350707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352102d8-7717-479f-a7aa-437fb4ada2bc None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:48.350996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352102d8-7717-479f-a7aa-437fb4ada2bc None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:48.351271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352102d8-7717-479f-a7aa-437fb4ada2bc None admin] PATH_INFO: `/v3/projects/8853027ac96d4eeaad2d1a863bb41284` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:48.352446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352102d8-7717-479f-a7aa-437fb4ada2bc None admin] RBAC: Authorizing `identity:get_project(project_id=8853027ac96d4eeaad2d1a863bb41284)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:48.353862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352102d8-7717-479f-a7aa-437fb4ada2bc None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:48.355485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 603/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:48 2022] GET /identity/v3/projects/8853027ac96d4eeaad2d1a863bb41284 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:48.361304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:48.456528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9735f-159d-43af-8425-0c6904e7c8f7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:48.487609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c3dee-f55b-405d-9458-c549ca59969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:48.488473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c3dee-f55b-405d-9458-c549ca59969e None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:48.488762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c3dee-f55b-405d-9458-c549ca59969e None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:48.489034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c3dee-f55b-405d-9458-c549ca59969e None admin] PATH_INFO: `/v3/projects/8853027ac96d4eeaad2d1a863bb41284/users/ed2e224a053c44ac9553e797cf7f9c0d/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:48.490963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c3dee-f55b-405d-9458-c549ca59969e None admin] RBAC: Authorizing `identity:create_grant(project_id=8853027ac96d4eeaad2d1a863bb41284, user_id=ed2e224a053c44ac9553e797cf7f9c0d, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:48.492413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c3dee-f55b-405d-9458-c549ca59969e None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:48.505478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 589/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:46:48 2022] PUT /identity/v3/projects/8853027ac96d4eeaad2d1a863bb41284/users/ed2e224a053c44ac9553e797cf7f9c0d/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:46:50.785214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a4d41-c46e-4604-a7d9-55215cf59ba7 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:50.785626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a4d41-c46e-4604-a7d9-55215cf59ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:50.785775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a4d41-c46e-4604-a7d9-55215cf59ba7 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:50.787575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 604/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:46:50.792741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:50.793147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:50.793304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:50.810076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:46:50.811238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:46:50.874257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 590/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:46:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:46:50.897912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a4d41-c46e-4604-a7d9-55215cf59ba7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:50.991818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a4d41-c46e-4604-a7d9-55215cf59ba7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:51.022164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:51.022872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:51.023150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:51.023417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:51.033705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:46:51.040572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:46:51.041723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 605/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:46:51.048544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:51.140120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee490dc-f2f4-433f-8399-f407167cb2df None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:51.171778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:51.172461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:51.172744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:51.173018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:51.173754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:51.174062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:51.175422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:51.182937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 591/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:51.188792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:51.283162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfea0f-c5d8-429c-b3ea-54fc884a9a23 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:51.315160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:51.316045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:51.316328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:51.316601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] PATH_INFO: `/v3/users/ed2e224a053c44ac9553e797cf7f9c0d` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:51.317763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed2e224a053c44ac9553e797cf7f9c0d)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:51.319193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:51.320852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 606/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Mar 29 15:46:51 2022] GET /identity/v3/users/ed2e224a053c44ac9553e797cf7f9c0d => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:51.326932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:51.421050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9592ee-b2c9-4f97-aba4-6dd2c6d579be None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:51.452371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:51.453002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:51.453288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:51.453566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:51.518547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:51.520028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:51.611671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 592/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:46:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:46:51.617399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:51.710414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebaa90-4207-4f86-97ae-fb0c586938c7 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:51.741321 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e674bad-d404-4636-8600-878e14c31ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:51.742163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e674bad-d404-4636-8600-878e14c31ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:51.742446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e674bad-d404-4636-8600-878e14c31ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:51.742720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e674bad-d404-4636-8600-878e14c31ee4 None admin] PATH_INFO: `/v3/projects/8853027ac96d4eeaad2d1a863bb41284` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:51.743916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e674bad-d404-4636-8600-878e14c31ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=8853027ac96d4eeaad2d1a863bb41284)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:51.745363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e674bad-d404-4636-8600-878e14c31ee4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:51.747032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 607/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Mar 29 15:46:51 2022] GET /identity/v3/projects/8853027ac96d4eeaad2d1a863bb41284 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:46:51.753104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:46:51.844767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834ceba-8ea8-40a2-b2f3-85870338fd51 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:46:51.875568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:46:51.876170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:46:51.876451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:46:51.876724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:46:51.877543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=8853027ac96d4eeaad2d1a863bb41284, user.id=ed2e224a053c44ac9553e797cf7f9c0d) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:46:51.877852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:46:51.879259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bdbef-e2e1-4071-908b-4d74e9da87cd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:46:51.884706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 593/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:46:51 2022] GET /identity/v3/role_assignments?user.id=ed2e224a053c44ac9553e797cf7f9c0d&scope.project.id=8853027ac96d4eeaad2d1a863bb41284&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:53.064148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784d93-5fa5-49f5-91fa-fc90afe529bf None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:53.064148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784d93-5fa5-49f5-91fa-fc90afe529bf None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:53.064148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da784d93-5fa5-49f5-91fa-fc90afe529bf None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:53.064148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 608/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:47:53.071897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:53.072387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:53.072616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:53.093992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:47:53.095430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:47:53.176461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 594/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:47:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:47:53.208030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784d93-5fa5-49f5-91fa-fc90afe529bf None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:53.335675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da784d93-5fa5-49f5-91fa-fc90afe529bf None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:53.373080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:53.373862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:53.374154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:53.374484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:53.386302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:53.387875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:53.406529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:47:53.413266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 609/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:47:53.415331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:53.540722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae8b61-bbfd-4e64-b336-20123d8a2684 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:53.579343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:53.580092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:53.580372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:53.580912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:53.581692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:53.582004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:53.583905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f8c5a-bee0-4ce2-8cc6-c489104ed88c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:53.600966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 595/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:53.608444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:53.722142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa6950-40e5-45af-8a41-c60399146c9b None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:53.772149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52163-4184-47c9-9d3d-23292d469c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:53.772963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52163-4184-47c9-9d3d-23292d469c98 None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:53.773257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52163-4184-47c9-9d3d-23292d469c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:53.773651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52163-4184-47c9-9d3d-23292d469c98 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:53.774994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52163-4184-47c9-9d3d-23292d469c98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:53.776638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52163-4184-47c9-9d3d-23292d469c98 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:53.800428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 610/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Mar 29 15:47:53 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:47:56.346271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b866-6462-432b-b854-15c9f56e02b6 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:56.346801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b866-6462-432b-b854-15c9f56e02b6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:56.346899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b866-6462-432b-b854-15c9f56e02b6 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:56.348986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 596/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:47:56.354905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:56.355383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:56.355470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:56.372967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:47:56.374233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:47:56.457581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 611/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:47:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:47:56.481700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b866-6462-432b-b854-15c9f56e02b6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:56.598521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b866-6462-432b-b854-15c9f56e02b6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:56.637171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:56.637972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:56.638260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:56.638539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:56.651407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:47:56.660080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:47:56.666780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 597/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:47:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:47:56.668589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:56.792337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171f343-1340-4b21-92b2-ec4e0e14b581 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:56.833447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:56.834125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:56.834408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:56.834682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:56.835700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:56.836143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:56.838540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:56.847885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 612/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:56.853828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:56.964418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff2a55-78b1-4843-898c-71d6a1a10ff4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:57.007133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:57.008036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:57.008273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:57.008556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:57.020509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:57.022135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:57.039464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:47:57.046444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 598/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:47:57.048287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:57.153035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67184f9-49de-42ce-afe8-c08a23dce8c8 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:57.187388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:57.188208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:57.188593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:57.188968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:57.189787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:57.190193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:57.191717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:57.205034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 613/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:57.210931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:57.313705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58daf2-2f94-4f52-9916-bbec8fed046c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:57.354490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:57.356132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:57.356132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:57.356132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:57.363957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:57.365488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:57.385013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 15:47:57.392615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 599/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:47:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:47:57.392771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:57.507154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7b5d3-c6bd-49e4-929a-85920e537df2 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:57.543690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:57.544368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:57.544652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:57.544926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:57.545760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:57.546074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:57.547502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:57.566630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 614/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Mar 29 15:47:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:57.572928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:57.677284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bedf1d-db4f-4042-8952-1aa54d140d2a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:57.717329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88031876-71f1-473f-8665-b643ee80318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:57.717988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88031876-71f1-473f-8665-b643ee80318c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:57.718269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88031876-71f1-473f-8665-b643ee80318c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:57.718548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88031876-71f1-473f-8665-b643ee80318c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:57.801427 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88031876-71f1-473f-8665-b643ee80318c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:57.803312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88031876-71f1-473f-8665-b643ee80318c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:57.916026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 600/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:47:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:47:57.921529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:58.040759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1296b-4e53-4d02-947f-7b1ccc7e1142 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:58.080846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:58.081691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:58.081966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:58.082232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:58.096589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:58.098387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:58.120158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:47:58.123562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 615/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:47:58.128728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88031876-71f1-473f-8665-b643ee80318c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:58.254494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88031876-71f1-473f-8665-b643ee80318c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:58.290243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:58.290955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:58.291186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:58.291560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:58.292280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:58.292575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:58.294047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:58.308192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 601/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:58.313825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:58.428844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b64fa1-e48d-427d-90ce-4bc0ee30291e None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:58.471177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:58.472184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:58.472618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:58.473061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:58.482174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:58.483941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:58.500732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:47:58.501956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 616/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:47:58.509618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:58.628201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245df37a-5e51-453e-b413-ef4d956c4c8d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:58.668879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:58.669548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:58.669832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:58.670107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:58.670908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:58.671233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:58.672685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebc9ad-d7f5-4859-9871-c1db5f4f8ccd None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:58.688502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 602/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:47:58.694423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:47:58.818161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8bb66-151f-432e-b191-dcd871178458 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:47:58.859156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:47:58.859884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:47:58.860173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:47:58.860453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:47:58.861290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=43182ee871284e7c919f8dfc4f39fa79) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:47:58.861605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:47:58.863059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b44a-5ceb-452f-a28b-0ce4a445f9f1 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:47:58.868859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 617/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:47:58 2022] GET /identity/v3/role_assignments?user.id=43182ee871284e7c919f8dfc4f39fa79&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:01.362220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84f10-c0ef-4618-8b10-90843a59219d None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:01.362760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84f10-c0ef-4618-8b10-90843a59219d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:01.362886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c84f10-c0ef-4618-8b10-90843a59219d None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:01.364692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 603/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:01.371094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:01.371672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:01.371672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:01.388341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:01.389516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:01.459561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 618/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:48:01.485379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84f10-c0ef-4618-8b10-90843a59219d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:01.597430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c84f10-c0ef-4618-8b10-90843a59219d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:01.638601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:01.639329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:01.639648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:01.639999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:01.650620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:48:01.657496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:48:01.658673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 604/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:01.665260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:01.774397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ca84d-aab7-4846-9dda-055f919c4af1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:01.815465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:01.816220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:01.816629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:01.817025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:01.818044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] RBAC: Adding query filter params (name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:01.818397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:01.820059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:01.830815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 619/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:48:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:48:01.837178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:01.949516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f4e8b-d093-4f1d-95d1-0c18b7d8cef7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:01.985778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:01.986586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:01.986864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:01.987139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:01.997476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:01.998922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:02.014786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:02.015963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 605/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:02.022271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:02.125562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf7c7c-12d8-4d04-a8d0-1db1ba5de037 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:02.160610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:02.161336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:02.161663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:02.161961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:02.162732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:02.163045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:02.165244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:02.178193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 620/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:02.184736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:02.287941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8b440-fd7a-4a14-ab3c-bb382000be2c None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:02.323762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:02.324564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:02.325479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:02.325755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] PATH_INFO: `/v3/users/placement` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:02.333479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:02.334919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:02.348709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 15:48:02.349938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 606/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:48:02.356593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:02.478090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619f11f-2de3-4587-aa7e-f997e3436201 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:02.517373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:02.518318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:02.518618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:02.518868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:02.519757 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:02.520074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:02.521538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:02.539660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 621/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Mar 29 15:48:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:02.545328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:02.650477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49bc40-8fcb-4a95-b040-3ee7868362be None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:02.683934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:02.684733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:02.685022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:02.685292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:02.696917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:02.698433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:02.715514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:02.716704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 607/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:02.724114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:02.824928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026972-db88-4b6e-8507-6e18f0f66039 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:02.858617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:02.859314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:02.859615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:02.859987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:02.860719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:02.861123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:02.862726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:02.874351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 622/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:02.880551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:02.996563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f64805-32f7-47e2-ba6a-fb3574c87e70 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:03.030210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:03.030999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:03.031281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:03.031576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:03.038560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:03.040761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:03.054191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:48:03.055904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 608/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:48:03.062186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:03.167857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c08374-12b2-4805-a2bf-14afdb6ef579 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:03.204136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:03.204793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:03.205351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:03.205620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:03.206405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:03.206716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:03.208228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc0ea2-93b7-4fe4-9049-021a82996a19 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:03.223116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 623/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:03.229169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:03.334310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a015c-2332-4112-bdd3-eda0dd03d64a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:03.368790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b06b08-237d-49ed-b8ab-73ccc0771e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:03.369677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06b08-237d-49ed-b8ab-73ccc0771e4a None admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:03.369957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06b08-237d-49ed-b8ab-73ccc0771e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:03.370233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b06b08-237d-49ed-b8ab-73ccc0771e4a None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/43182ee871284e7c919f8dfc4f39fa79/roles/d43a3606a82c4186abf72c4adbc136e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:03.384740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b06b08-237d-49ed-b8ab-73ccc0771e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=43182ee871284e7c919f8dfc4f39fa79, role_id=d43a3606a82c4186abf72c4adbc136e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:03.386179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b06b08-237d-49ed-b8ab-73ccc0771e4a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:03.397901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 609/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:48:03 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/43182ee871284e7c919f8dfc4f39fa79/roles/d43a3606a82c4186abf72c4adbc136e6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:48:05.803673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa56f7-a800-4138-bc4f-bfb1e3e72ad9 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:05.804285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa56f7-a800-4138-bc4f-bfb1e3e72ad9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:05.804983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa56f7-a800-4138-bc4f-bfb1e3e72ad9 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:05.807184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 624/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:05.813063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:05.813533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:05.813625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:05.832514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:05.834204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:05.908229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 610/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:48:05.935729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa56f7-a800-4138-bc4f-bfb1e3e72ad9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:06.065653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa56f7-a800-4138-bc4f-bfb1e3e72ad9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:06.102191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:06.102988 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:06.103270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:06.103575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] PATH_INFO: `/v3/roles/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:06.113735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:48:06.121795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 29 15:48:06.123254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 625/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Mar 29 15:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:06.129340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:06.234734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd7326-e5b5-467c-af10-5709d48dd1f9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:06.272598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:06.273357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:06.273637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:06.273911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:06.274649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] RBAC: Adding query filter params (name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:06.274952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:06.276465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:06.284906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 611/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Mar 29 15:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:06.290624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:06.394517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb271-ac2e-49d3-aaa8-9f687b951baf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:06.431496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:06.432455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:06.432889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:06.433242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:06.446585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:06.448414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:06.467696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:06.469231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 626/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:48:06.475186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:06.583617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87373db-c986-4373-8211-54f3b2f3db57 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:06.621005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:06.621902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:06.622504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:06.622852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:06.623712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:06.624090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:06.625521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:06.638947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 612/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:06.644778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:06.756265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0de82-9986-4ebe-a0cd-e8e273561792 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:06.792126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:06.793044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:06.793329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:06.793609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:06.801264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:06.802757 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:06.816105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 15:48:06.817275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 627/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:06.823791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:06.931725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82ea6b-3353-45b2-952e-da005e93eddf None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:06.977603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:06.978461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:06.978833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:06.979221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:06.980363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:06.980785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:06.982925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:07.005398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 613/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Mar 29 15:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:48:07.011572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:07.118794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371922f-9dac-4831-8f5f-0d3cf1bcce6c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:07.154169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:07.154945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:07.155354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:07.155688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:07.225794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:07.227961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:07.335074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 628/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:48:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 29 15:48:07.341589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:07.455202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2b3a3-9798-4174-86c3-dc43047b2ea0 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:07.497085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:07.497965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:07.498385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:07.498675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:07.510229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:07.512180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:07.530931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:07.532371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 614/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 29 15:48:07.538406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:07.644244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b628716-b893-436b-b680-1eee1b3a7e28 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:07.680579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941391-8232-400e-92df-d8bfe472712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:07.681235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941391-8232-400e-92df-d8bfe472712c None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:07.681519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941391-8232-400e-92df-d8bfe472712c None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:07.681794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941391-8232-400e-92df-d8bfe472712c None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:07.682687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941391-8232-400e-92df-d8bfe472712c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:07.683040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941391-8232-400e-92df-d8bfe472712c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:07.684762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941391-8232-400e-92df-d8bfe472712c None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:07.698816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 629/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:07.705264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:07.816337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bb46e-0d3c-4968-b962-0669feb7f26d None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:07.853468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:07.854295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:07.854667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:07.854951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:07.862312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:07.863840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:07.878005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:48:07.879334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 615/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:07.886195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941391-8232-400e-92df-d8bfe472712c None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:08.002212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941391-8232-400e-92df-d8bfe472712c None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:08.040560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:08.041349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:08.041642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:08.041919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:08.042708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:08.043025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:08.044758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20357fea-d897-4a3e-81c0-dfbdb5c2c399 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:08.060595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 630/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:08.069112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:08.185837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2fdc7-6253-41cb-a9f4-e6ed7b83aa87 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:08.222795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:08.223592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:08.223880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:08.224158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:08.224992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] RBAC: Adding query filter params (role.id=d43a3606a82c4186abf72c4adbc136e6, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=43182ee871284e7c919f8dfc4f39fa79) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:08.225310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:08.227074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46582e3e-9888-46ae-b1a6-e1ce6e05d9b7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:08.233314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 616/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:48:08 2022] GET /identity/v3/role_assignments?user.id=43182ee871284e7c919f8dfc4f39fa79&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=d43a3606a82c4186abf72c4adbc136e6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:10.774648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c09dc1-850a-4afa-b961-4ace75725967 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:10.775165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c09dc1-850a-4afa-b961-4ace75725967 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:10.775485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c09dc1-850a-4afa-b961-4ace75725967 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:10.777814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 631/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:10.783347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:10.783854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:10.783989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:10.802907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:10.804259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:10.875641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 617/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:48:10.902383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c09dc1-850a-4afa-b961-4ace75725967 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:11.026768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c09dc1-850a-4afa-b961-4ace75725967 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:11.060959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:11.061825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:11.062104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:11.062413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:11.073721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:48:11.081332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:48:11.082719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 632/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:48:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:11.088644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:11.197807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d035c8-1b74-483f-9d0a-757439fe93fb None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:11.235146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:11.235863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:11.236195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:11.236469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:11.237373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:11.237723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:11.239183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:11.249044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 618/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:11.255709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:11.364185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c01cc-6900-4b49-b7a6-074e76f34fd1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:11.399735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:11.400535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:11.400822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:11.401097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:11.412192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:11.413763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:11.431373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:11.432853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 633/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:11.438844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:11.543653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30835149-7c57-4b54-897b-024fae21fbef None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:11.582608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:11.583275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:11.583572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:11.583847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:11.584567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:11.584872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:11.586798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:11.599137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 619/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:11.605011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:11.718695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dd28f-0ed1-45cd-8ae8-6c9bc00b29ce None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:11.753334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:11.754153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:11.754435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:11.754709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:11.764193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:11.765209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:11.779729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 15:48:11.780991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 634/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:11.786905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:11.886718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08022-17c2-4989-9262-18ff6bca87f8 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:11.921400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:11.922079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:11.922362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:11.922635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:11.923476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:11.923814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:11.925273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:11.946022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 620/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Mar 29 15:48:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:11.950992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:12.053268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe57b30-4f86-44fe-b7f9-9f564f4c932a None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:12.086353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:12.087000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:12.087285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:12.087585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:12.156861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:12.158315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:12.252655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 635/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:48:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:48:12.258590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:12.349500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecb79b-fdf4-419e-9b75-44aef2a765bc None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:12.381762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:12.382708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:12.382864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:12.383135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:12.392406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:12.393828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:12.410193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:12.411303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 621/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:12.417536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:12.508583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82e27c-7329-4bac-b2e4-3e5a23d30213 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:12.540432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:12.541080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:12.541366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:12.541644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:12.542361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:12.542667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:12.544075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:12.555182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 636/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:12.560591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:12.652755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6560c-939d-4751-a7e1-4924be79472a None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:12.685210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:12.685984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:12.686266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:12.686539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:12.692935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:12.694363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:12.707155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:48:12.708318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 622/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:12.714009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:12.807746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d86f2-0790-4270-9907-e1767d702430 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:12.839965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:12.840628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:12.840910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:12.841189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:12.841970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:12.842281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:12.843734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9487c9-2c41-4abe-964e-e148dd59fc3d None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:12.861045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 637/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:12.862029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:12.961145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae758b-96ad-4351-a679-65d2a635a9e7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:13.008771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:13.009666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:13.010207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:13.010461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:13.011294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=43182ee871284e7c919f8dfc4f39fa79) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:13.011648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:13.013099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f70c7-81b3-4dec-b9e6-dfeadab53f0b None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:13.019023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 623/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:48:12 2022] GET /identity/v3/role_assignments?user.id=43182ee871284e7c919f8dfc4f39fa79&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:15.250085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ea0e-f104-4812-9109-42a58e045cba None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:15.250596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ea0e-f104-4812-9109-42a58e045cba None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:15.250705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ea0e-f104-4812-9109-42a58e045cba None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:15.252436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 638/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:15.258214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:15.258609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:15.258760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:15.274875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:15.276061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:15.337609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 624/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:48:15.359380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9ea0e-f104-4812-9109-42a58e045cba None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:15.461769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9ea0e-f104-4812-9109-42a58e045cba None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:15.492913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:15.493689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:15.493971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:15.494246 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:15.503777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:48:15.510548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:48:15.511731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 639/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:15.518670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:15.610796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1ab61-0617-43d4-9522-616a5fc91ec3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:15.642177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:15.642824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:15.643108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:15.643383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:15.644148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:15.644456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:15.645817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:15.653376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 625/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:15.658919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:15.751921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfb76b-0190-4cdd-aa9b-368b7b5ca0a1 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:15.783043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:15.783868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:15.784151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:15.784457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:15.795271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:15.796748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:15.813400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:15.814571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 640/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:15.820340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:15.912742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302b173-3d27-4411-a9bd-7e16df295d04 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:15.946095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:15.946773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:15.947050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:15.947322 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:15.948069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:15.948371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:15.949734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:15.962786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 626/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:15.968591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:16.075278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6592ea4-d6ce-429b-b743-213b88a7ba50 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:16.107914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:16.108703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:16.108990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:16.109266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:16.116326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:16.117773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:16.130685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 15:48:16.131850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 641/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:16.138107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:16.232204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01225855-f0b1-4fbf-8a6c-01889a00cfe9 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:16.263710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:16.264363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:16.264649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:16.264927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:16.265753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:16.266066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:16.267487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:16.284003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 627/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Mar 29 15:48:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:16.290273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:16.385687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631679e6-1181-447d-9a05-40cdead9f3e6 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:16.418693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:16.419477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:16.419793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:16.420069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:16.430596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:16.432083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:16.448457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:16.449598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 642/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:16.455581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:16.548795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4d7bd-fe62-400e-b3d2-0aa616723d73 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:16.580790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:16.581439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:16.581723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:16.582009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:16.582714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:16.583019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:16.584407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:16.595003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 628/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:16.600521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:16.694589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4878-0716-4997-bdea-20ee123868ab None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:16.725635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:16.726437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:16.726721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:16.726997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:16.733303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:16.734741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:16.748259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:48:16.749418 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 643/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:16.755153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:16.852182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102b227-1f5b-497f-92c8-39c6bdcf08c7 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:16.884342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:16.884994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:16.885281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:16.885559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:16.886339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:16.886650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:16.888116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f9d28-9401-4eb6-a274-3aede19e5c62 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:16.899408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 629/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:16.905313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:17.008672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5eef3b-8d27-4595-97f6-9665122eb535 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:17.040559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ce689-ba3c-407d-a1b1-dd4e3aaa6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:17.041431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ce689-ba3c-407d-a1b1-dd4e3aaa6575 None admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:17.041711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ce689-ba3c-407d-a1b1-dd4e3aaa6575 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:17.041985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ce689-ba3c-407d-a1b1-dd4e3aaa6575 None admin] PATH_INFO: `/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/43182ee871284e7c919f8dfc4f39fa79/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:17.043932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ce689-ba3c-407d-a1b1-dd4e3aaa6575 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ce31a148ff44bd98a0c1f1e2c5a172b, user_id=43182ee871284e7c919f8dfc4f39fa79, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:17.045362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ce689-ba3c-407d-a1b1-dd4e3aaa6575 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:17.057950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 644/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Mar 29 15:48:16 2022] PUT /identity/v3/projects/5ce31a148ff44bd98a0c1f1e2c5a172b/users/43182ee871284e7c919f8dfc4f39fa79/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:48:19.300750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ae1d-4840-47a9-af8b-96c45b01e923 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:19.301282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ae1d-4840-47a9-af8b-96c45b01e923 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:19.301375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ae1d-4840-47a9-af8b-96c45b01e923 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:19.303083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 630/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:19.308759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:19.309186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:19.309354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:19.326156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:19.327332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:19.392009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 645/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:48:19.416595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ae1d-4840-47a9-af8b-96c45b01e923 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:19.512932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ae1d-4840-47a9-af8b-96c45b01e923 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:19.544549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:19.545324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:19.545599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:19.545868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:19.556441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 29 15:48:19.563149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 29 15:48:19.564345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 631/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Mar 29 15:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:19.571328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:19.666776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4b2a3-d44d-4530-9b65-1c27a01a3e26 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:19.700971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:19.701625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:19.701904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:19.702176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:19.702908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:19.703210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:19.704865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:19.713001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 646/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Mar 29 15:48:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:19.718691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:19.813898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30a15-bd29-4155-960f-37cd5bf8ee63 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:19.845542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:19.846326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:19.846610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:19.846887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:19.857408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:19.858847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:19.874401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:19.875571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 632/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:19.881308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:19.980209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21f3fd-6f12-4937-9137-92d35a626fcf None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:20.018229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:20.019005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:20.019277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:20.019569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:20.020338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:20.020721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:20.022136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:20.034215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 647/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:20.039904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:20.134341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4b04-9fd9-41dc-bafc-6b034d01f410 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:20.166473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:20.167266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:20.167570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:20.167854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:20.175049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:20.176510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:20.190100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 29 15:48:20.191250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 633/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:20.197670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:20.292846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4369be6-02ff-420c-99c5-6b19d852d2c4 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:20.324354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:20.325004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:20.325284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:20.325556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:20.326371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:20.326675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:20.328429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:20.345229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 648/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Mar 29 15:48:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:20.351395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:20.444813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937cd09-c0a9-45a9-a1ac-1acbcd085d37 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:20.476098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:20.476728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:20.477011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:20.477289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:20.540011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:20.541449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:20.631153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 634/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Mar 29 15:48:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 29 15:48:20.636889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:20.730784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e15d24-caa3-4e73-a3c0-c6da6afdafb5 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:20.763949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:20.764754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:20.765133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:20.765406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:20.775264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:20.776773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:20.792702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 29 15:48:20.793854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 649/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:20.799438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:20.894213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d82b24-0a64-4cf9-8839-bcacd36ca366 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:20.926048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:20.926693 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:20.926979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:20.927257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:20.928001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:20.928307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:20.929693 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:20.941879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 635/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Mar 29 15:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:20.948492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:21.045618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ee64-9644-40b7-9a63-884b38632224 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:21.078705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:21.079801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:21.080086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:21.080360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:21.087317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:21.088949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:21.102081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING keystone.server.flask.application [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 29 15:48:21.103234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 650/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Mar 29 15:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:21.109121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:21.203572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd6aa9-270c-4bd0-807d-eec3dc834da4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:21.235459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:21.236141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:21.236427 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:21.236704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:21.237478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:21.237784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:21.239204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49b3b7-b115-48d8-bdb6-2056bb33e028 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:21.251062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 636/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Mar 29 15:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:21.257494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:21.349380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5de711-fbf7-41d6-879d-0020fc9d9d19 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:21.380506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:21.381136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:21.381413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:21.382222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:21.383033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] RBAC: Adding query filter params (role.id=ea99f201bccb4d7c9187bd6b6d4e25ed, scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b, user.id=43182ee871284e7c919f8dfc4f39fa79) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:21.383342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:21.384817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e309bb7-d75e-4dbc-879d-142497a30969 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:21.390243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 651/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Mar 29 15:48:21 2022] GET /identity/v3/role_assignments?user.id=43182ee871284e7c919f8dfc4f39fa79&scope.project.id=5ce31a148ff44bd98a0c1f1e2c5a172b&role.id=ea99f201bccb4d7c9187bd6b6d4e25ed => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:23.641777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31bbb-388f-4179-ad27-ef473273dc55 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:23.642336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31bbb-388f-4179-ad27-ef473273dc55 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:23.642336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31bbb-388f-4179-ad27-ef473273dc55 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:23.644153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 637/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:23.649635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:23.650155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:23.650301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:23.666917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:23.668095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:23.729660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 652/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:48:23.751395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31bbb-388f-4179-ad27-ef473273dc55 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:23.848148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31bbb-388f-4179-ad27-ef473273dc55 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:23.881059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:23.881873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:23.882157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:23.882433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:23.883076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:23.884470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:23.895193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 29 15:48:23.896314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 638/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:48:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:23.902389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:24.013201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80467cb6-f157-4bec-baab-b3bec86d77d1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:24.046067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:24.046724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:24.047030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:24.047303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:24.048043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:24.048350 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:24.049714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4a2be-4a1b-43a3-a2fb-d2e046dc0052 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:24.054833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 653/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Mar 29 15:48:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:24.060594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:24.154707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce33f-b0f0-49da-80ca-4e68c92e46a4 None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:24.189397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:24.190054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:24.190338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:24.190615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] PATH_INFO: `/v3/services` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:24.191318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] RBAC: Adding query filter params (type=placement) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:24.191656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:24.193024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a89bc-c4f9-4362-b4fd-6a02605f58bf None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:24.197251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 639/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Mar 29 15:48:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:48:26.486133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4a17-b367-46d5-a23b-b6155419827a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:26.486661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4a17-b367-46d5-a23b-b6155419827a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:26.486661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4a17-b367-46d5-a23b-b6155419827a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:26.488477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 654/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:26.494226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085213-b426-46b8-a4c4-f5ef02d0c46c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:26.494652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085213-b426-46b8-a4c4-f5ef02d0c46c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:26.494770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085213-b426-46b8-a4c4-f5ef02d0c46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:26.511509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8b085213-b426-46b8-a4c4-f5ef02d0c46c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:26.512685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8b085213-b426-46b8-a4c4-f5ef02d0c46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:26.575424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 640/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:48:26.599379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4a17-b367-46d5-a23b-b6155419827a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:26.700439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4a17-b367-46d5-a23b-b6155419827a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:26.733584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dd98c-928e-4195-89c5-4ec0986277cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:26.734239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd98c-928e-4195-89c5-4ec0986277cb None admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:26.734524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd98c-928e-4195-89c5-4ec0986277cb None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:26.734797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dd98c-928e-4195-89c5-4ec0986277cb None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:26.735520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dd98c-928e-4195-89c5-4ec0986277cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:26.736956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dd98c-928e-4195-89c5-4ec0986277cb None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:26.749883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 655/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Mar 29 15:48:26 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:48:29.087969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595d60d-36b7-463d-85d1-8061ba9f0d38 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:29.088491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595d60d-36b7-463d-85d1-8061ba9f0d38 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:29.088491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595d60d-36b7-463d-85d1-8061ba9f0d38 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:29.090189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 641/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:29.095185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:29.095607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:29.095763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:29.112542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:29.113710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:29.182530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 656/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 29 15:48:29.206572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595d60d-36b7-463d-85d1-8061ba9f0d38 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:29.306082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595d60d-36b7-463d-85d1-8061ba9f0d38 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:29.337631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:29.338467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:29.338701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:29.338979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:29.339653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:29.341019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:29.353248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 29 15:48:29.354601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 642/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:48:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:29.360425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:29.458601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a87d4-663b-49a1-9210-2a4cbcb5bae9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:29.491225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:29.491918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:29.492201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:29.492477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:29.493180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:29.493484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:29.494858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:29.499940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 657/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Mar 29 15:48:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:29.505986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:29.600818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d130a7-e02d-4d23-ae32-318fde4da2ba None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:29.633862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:29.634504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:29.634791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:29.635096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:29.635908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] RBAC: Adding query filter params (interface=public, service_id=d6e05ba0b9f44a12a04f95283ca8333b, region_id=RegionOne) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:29.636221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:29.637588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16852c-16d8-4010-bcc8-4bfbafc79bc0 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:29.642283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 643/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Mar 29 15:48:29 2022] GET /identity/v3/endpoints?service_id=d6e05ba0b9f44a12a04f95283ca8333b&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:29.647899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:29.739030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247953-9f4e-4bf5-b032-cf3c6230b8d3 None admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:29.771319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d0cb-9143-41ef-a0e0-2839ce43947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:29.772508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d0cb-9143-41ef-a0e0-2839ce43947a None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:29.772788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d0cb-9143-41ef-a0e0-2839ce43947a None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:29.773061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d0cb-9143-41ef-a0e0-2839ce43947a None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:29.773736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9d0cb-9143-41ef-a0e0-2839ce43947a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:29.775097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9d0cb-9143-41ef-a0e0-2839ce43947a None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:29.781711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 658/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Mar 29 15:48:29 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:48:32.057042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de7e4-8967-4e79-abff-d8d9566faa04 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:32.057539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de7e4-8967-4e79-abff-d8d9566faa04 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:32.057539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de7e4-8967-4e79-abff-d8d9566faa04 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:32.059256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 644/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:48:32.064482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:32.064853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:32.065042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:32.081524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:48:32.082700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:48:32.145678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 659/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:48:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 29 15:48:32.169983 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de7e4-8967-4e79-abff-d8d9566faa04 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:32.270616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de7e4-8967-4e79-abff-d8d9566faa04 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:32.302684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:32.303467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:32.303772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:32.304046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:32.304683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:32.306070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:32.316615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING keystone.server.flask.application [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 29 15:48:32.317692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 645/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Mar 29 15:48:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 29 15:48:32.324276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:32.416524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28427d50-a80e-4d78-ba11-593c2d07c9ba None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:32.448101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:32.448755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:32.449041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:32.449318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] PATH_INFO: `/v3/services` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:32.450017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:48:32.450322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:32.451725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e21d9-f1ee-432a-b93b-3c9e8a6eeaf2 None admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:32.456862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 660/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Mar 29 15:48:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:48:32.462675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:48:32.562194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfe3c0-412c-430c-bf7a-0232b30fa1ba None admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:48:32.598108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50e5bf-f256-4e08-9d09-3abad4207f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:48:32.598689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e5bf-f256-4e08-9d09-3abad4207f92 None admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:48:32.598975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e5bf-f256-4e08-9d09-3abad4207f92 None admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:48:32.599253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50e5bf-f256-4e08-9d09-3abad4207f92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:48:32.600620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50e5bf-f256-4e08-9d09-3abad4207f92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:48:32.601984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50e5bf-f256-4e08-9d09-3abad4207f92 None admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:48:32.619636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 646/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Mar 29 15:48:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:49:36.309435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f7e3-4723-4015-a247-897b93a9744a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:36.309991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f7e3-4723-4015-a247-897b93a9744a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:36.309991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f7e3-4723-4015-a247-897b93a9744a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:36.311807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 661/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:36.317038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124956-9bd9-469f-81c3-4f69fd1f8388 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:36.317465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124956-9bd9-469f-81c3-4f69fd1f8388 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:36.317608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124956-9bd9-469f-81c3-4f69fd1f8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:36.422717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ee124956-9bd9-469f-81c3-4f69fd1f8388 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:36.425353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ee124956-9bd9-469f-81c3-4f69fd1f8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:36.581987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 647/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:36.635429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c0862-4277-45e0-8772-0f63cb2c9a32 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:36.635965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c0862-4277-45e0-8772-0f63cb2c9a32 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:36.636249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c0862-4277-45e0-8772-0f63cb2c9a32 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:36.638567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 662/1309] 10.222.0.23 () {54 vars in 963 bytes} [Tue Mar 29 15:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:36.645587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b686-a336-4f1d-abe7-d18b39ee08c3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:36.645944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b686-a336-4f1d-abe7-d18b39ee08c3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:36.646339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b686-a336-4f1d-abe7-d18b39ee08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:36.741539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-33b4b686-a336-4f1d-abe7-d18b39ee08c3 None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:36.743238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-33b4b686-a336-4f1d-abe7-d18b39ee08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:36.835929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 648/1310] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Mar 29 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:36.838854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c0862-4277-45e0-8772-0f63cb2c9a32 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:36.840726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a85c0862-4277-45e0-8772-0f63cb2c9a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:36.944089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c0862-4277-45e0-8772-0f63cb2c9a32 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:37.017260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:37.018180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:37.018464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:37.018792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:37.020532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:37.136544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:37.138102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a8eef-bd9e-4cf8-a613-0be3b11b5c8f service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:37.157266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 663/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:39.740209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35373-c753-45b8-ad80-91e1c01ae827 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:39.741045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35373-c753-45b8-ad80-91e1c01ae827 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:39.741481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35373-c753-45b8-ad80-91e1c01ae827 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:39.743254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 649/1312] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:49:39.748776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc419-efa9-49c4-9477-27e24af04c0a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:39.749219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc419-efa9-49c4-9477-27e24af04c0a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:39.749336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc419-efa9-49c4-9477-27e24af04c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:39.829247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ef7fc419-efa9-49c4-9477-27e24af04c0a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:39.830610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ef7fc419-efa9-49c4-9477-27e24af04c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:39.926475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 664/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:39.965013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35373-c753-45b8-ad80-91e1c01ae827 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:39.966748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-06f35373-c753-45b8-ad80-91e1c01ae827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:40.068949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35373-c753-45b8-ad80-91e1c01ae827 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:40.141416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:40.142815 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:40.143271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:40.143731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:40.145513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:40.254257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:40.256106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d672b-2fe2-44cd-9dc7-49722a2f5080 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:40.279867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 650/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:42.903341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b682d-edd6-4933-a624-6f5f6ed9ef53 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:42.903855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b682d-edd6-4933-a624-6f5f6ed9ef53 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:42.904123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b682d-edd6-4933-a624-6f5f6ed9ef53 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:42.906038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 665/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:42.911336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af60f1-4b5a-4981-8b8c-886e547f4832 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:42.911801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af60f1-4b5a-4981-8b8c-886e547f4832 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:42.911938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af60f1-4b5a-4981-8b8c-886e547f4832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:42.975762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b8af60f1-4b5a-4981-8b8c-886e547f4832 None None] MFA Rules not processed for user `25fc5870b2554018a0da2cb26e1365b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:42.976959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b8af60f1-4b5a-4981-8b8c-886e547f4832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:43.068687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 651/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:43.124121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077557a-de02-4a9b-806f-596b95891a42 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:43.124410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077557a-de02-4a9b-806f-596b95891a42 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:43.124689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077557a-de02-4a9b-806f-596b95891a42 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:43.126478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 666/1317] 10.222.0.23 () {54 vars in 963 bytes} [Tue Mar 29 15:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:43.132687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bb95-f24e-4ae8-bb7e-a08b530c4d51 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:43.132976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bb95-f24e-4ae8-bb7e-a08b530c4d51 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:43.133317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97bb95-f24e-4ae8-bb7e-a08b530c4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:43.207016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0c97bb95-f24e-4ae8-bb7e-a08b530c4d51 None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:43.208218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0c97bb95-f24e-4ae8-bb7e-a08b530c4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:43.278156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 652/1318] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Mar 29 15:49:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:43.287875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077557a-de02-4a9b-806f-596b95891a42 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:43.289456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0077557a-de02-4a9b-806f-596b95891a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:43.387097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077557a-de02-4a9b-806f-596b95891a42 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:43.456329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:43.456976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:43.457260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:43.457533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:43.459169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:43.560712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:43.562139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a76620-eacc-4cf7-9ef4-edba19453844 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:43.580317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 667/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:46.803109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291296-a8cf-483a-b190-bf82a31a5071 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:46.803605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291296-a8cf-483a-b190-bf82a31a5071 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:46.803721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85291296-a8cf-483a-b190-bf82a31a5071 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:46.805431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 653/1320] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:46.810581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9078-77c2-44c0-a496-94c49bda88e3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:46.810987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9078-77c2-44c0-a496-94c49bda88e3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:46.811133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc9078-77c2-44c0-a496-94c49bda88e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:46.872631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e9bc9078-77c2-44c0-a496-94c49bda88e3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:46.873813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e9bc9078-77c2-44c0-a496-94c49bda88e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:46.974176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 668/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:47.014514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85291296-a8cf-483a-b190-bf82a31a5071 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:47.016004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-85291296-a8cf-483a-b190-bf82a31a5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:47.114718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85291296-a8cf-483a-b190-bf82a31a5071 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:47.182769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:47.183414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:47.183724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:47.184000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:47.185632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:47.292717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:47.294074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64ba22-c80a-4e70-9c81-ede4e10e3b5b service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:47.311803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 654/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:50.280296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b61bf-623b-4b1f-967c-d8b5d80f70d3 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:50.280834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b61bf-623b-4b1f-967c-d8b5d80f70d3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:50.281038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b61bf-623b-4b1f-967c-d8b5d80f70d3 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:50.283789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 669/1323] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:50.289209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940f8f-cba6-4820-aebc-492f07397e25 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:50.289648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940f8f-cba6-4820-aebc-492f07397e25 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:50.289893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940f8f-cba6-4820-aebc-492f07397e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:50.355305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e2940f8f-cba6-4820-aebc-492f07397e25 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:50.356535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e2940f8f-cba6-4820-aebc-492f07397e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:50.449629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 655/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:49:50.485915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b61bf-623b-4b1f-967c-d8b5d80f70d3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:50.487450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-714b61bf-623b-4b1f-967c-d8b5d80f70d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:50.590646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b61bf-623b-4b1f-967c-d8b5d80f70d3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:50.661066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:50.661724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:50.662021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:50.662285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:50.663960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:50.773616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:50.774908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104964ac-07d0-4e33-98a7-d4ceef0099f7 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:50.792258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 670/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:53.220154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209fc05-c200-409c-9437-b51cdded5871 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:53.220685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209fc05-c200-409c-9437-b51cdded5871 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:53.220685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209fc05-c200-409c-9437-b51cdded5871 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:53.222423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 656/1326] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:53.227799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0652e-b50e-469a-a4ed-43c5980effd5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:53.228259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0652e-b50e-469a-a4ed-43c5980effd5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:53.228491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0652e-b50e-469a-a4ed-43c5980effd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:53.292283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a5b0652e-b50e-469a-a4ed-43c5980effd5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:53.293484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a5b0652e-b50e-469a-a4ed-43c5980effd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:53.387007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 671/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:53.422859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209fc05-c200-409c-9437-b51cdded5871 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:53.424460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a209fc05-c200-409c-9437-b51cdded5871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:53.524299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209fc05-c200-409c-9437-b51cdded5871 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:53.594436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:53.595087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:53.595370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:53.595682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:53.597318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:53.702430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:53.704619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f82be1-4fb2-4c2a-a69c-1aae9fb71277 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:53.722519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 657/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:56.032404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d7a77-3927-40cd-8d8f-1899e3c06248 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:56.032956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d7a77-3927-40cd-8d8f-1899e3c06248 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:56.032956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d7a77-3927-40cd-8d8f-1899e3c06248 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:56.034821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 672/1329] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:56.040794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd0e06-bd96-4ebc-8e61-18718e104f31 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:56.041409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd0e06-bd96-4ebc-8e61-18718e104f31 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:56.041409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd0e06-bd96-4ebc-8e61-18718e104f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:56.104419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-56bd0e06-bd96-4ebc-8e61-18718e104f31 None None] MFA Rules not processed for user `25fc5870b2554018a0da2cb26e1365b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:56.105593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-56bd0e06-bd96-4ebc-8e61-18718e104f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:56.200015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 658/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:56.238122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d7a77-3927-40cd-8d8f-1899e3c06248 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:56.239705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ba9d7a77-3927-40cd-8d8f-1899e3c06248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:56.341476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d7a77-3927-40cd-8d8f-1899e3c06248 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:56.414445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:56.415087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:56.415367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:56.415675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:56.417283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:56.526443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:56.527914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948cfea-cbdb-4e71-b8a1-9da2c8412862 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:56.544893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 673/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:49:59.156865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465ade-a99e-48a5-900b-c81cd9bdd278 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:59.157378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465ade-a99e-48a5-900b-c81cd9bdd278 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:59.157494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a465ade-a99e-48a5-900b-c81cd9bdd278 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:59.159221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 659/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:49:59.164661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285fefc-fd64-4237-97d4-6bcc711f6955 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:59.165053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285fefc-fd64-4237-97d4-6bcc711f6955 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:59.165218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285fefc-fd64-4237-97d4-6bcc711f6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:59.231664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9285fefc-fd64-4237-97d4-6bcc711f6955 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:49:59.232881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9285fefc-fd64-4237-97d4-6bcc711f6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:59.335570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 674/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:49:59.371101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a465ade-a99e-48a5-900b-c81cd9bdd278 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:49:59.372816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7a465ade-a99e-48a5-900b-c81cd9bdd278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:59.481739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a465ade-a99e-48a5-900b-c81cd9bdd278 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:49:59.554170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:49:59.554745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:49:59.555034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:49:59.555315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:49:59.557036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:49:59.662344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:49:59.663830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b37ea-08cd-428e-bef9-4b1a1e91679b service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:49:59.681553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 660/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:02.170099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7527a-621d-45e7-839c-01d27d8cde16 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:02.170604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7527a-621d-45e7-839c-01d27d8cde16 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:02.170604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7527a-621d-45e7-839c-01d27d8cde16 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:02.172375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 675/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:02.177532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efee110-6764-48d3-9944-582304f136d0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:02.177916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efee110-6764-48d3-9944-582304f136d0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:02.178083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efee110-6764-48d3-9944-582304f136d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:02.239920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9efee110-6764-48d3-9944-582304f136d0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:02.241092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9efee110-6764-48d3-9944-582304f136d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:02.334418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 661/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:02.374741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7527a-621d-45e7-839c-01d27d8cde16 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:02.376311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5bc7527a-621d-45e7-839c-01d27d8cde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:02.477901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7527a-621d-45e7-839c-01d27d8cde16 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:02.549000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:02.549649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:02.549931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:02.550215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:02.551881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:02.669024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:02.670693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956235d-8fc3-4b9b-bcb9-b8344527914f service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:02.688632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 676/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:05.318135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4e81-86ee-4d2c-a6dd-e09cf2296de5 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:05.318667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4e81-86ee-4d2c-a6dd-e09cf2296de5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:05.318667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a4e81-86ee-4d2c-a6dd-e09cf2296de5 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:05.320505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 662/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:05.325879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea8c0-d802-4340-9d83-09e59237a4a4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:05.326322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea8c0-d802-4340-9d83-09e59237a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:05.326440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea8c0-d802-4340-9d83-09e59237a4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:05.388518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5e3ea8c0-d802-4340-9d83-09e59237a4a4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:05.389711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5e3ea8c0-d802-4340-9d83-09e59237a4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:05.484065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 677/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:05.519751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a4e81-86ee-4d2c-a6dd-e09cf2296de5 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:05.521307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9f3a4e81-86ee-4d2c-a6dd-e09cf2296de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:05.622922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a4e81-86ee-4d2c-a6dd-e09cf2296de5 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:05.695957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:05.696603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:05.696889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:05.697168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:05.698806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:05.806336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:05.807826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3691fe2-373f-453b-bee8-ded1d3a18442 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:05.824787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 663/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:10.109974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825051b-9587-45ae-87f8-d80cf216062d None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:10.110533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825051b-9587-45ae-87f8-d80cf216062d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:10.110533 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825051b-9587-45ae-87f8-d80cf216062d None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:10.112265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 678/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:10.117343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd20e-8e63-485b-935f-53e0f9b118a1 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:10.117782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd20e-8e63-485b-935f-53e0f9b118a1 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:10.117904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debd20e-8e63-485b-935f-53e0f9b118a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:10.188572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8debd20e-8e63-485b-935f-53e0f9b118a1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:10.189740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8debd20e-8e63-485b-935f-53e0f9b118a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:10.290904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 664/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:10.329479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825051b-9587-45ae-87f8-d80cf216062d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:10.331817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1825051b-9587-45ae-87f8-d80cf216062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:10.440014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825051b-9587-45ae-87f8-d80cf216062d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:10.443494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba862cf-f5fa-4962-8c28-5b60ffff1f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:10.444186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba862cf-f5fa-4962-8c28-5b60ffff1f81 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:10.444470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba862cf-f5fa-4962-8c28-5b60ffff1f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:10.444745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba862cf-f5fa-4962-8c28-5b60ffff1f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:10.454436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba862cf-f5fa-4962-8c28-5b60ffff1f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:10.455925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba862cf-f5fa-4962-8c28-5b60ffff1f81 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:10.465419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 679/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:13.410845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66f14-4aa2-42cb-b842-1ea4f9fcdf6b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:13.411385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66f14-4aa2-42cb-b842-1ea4f9fcdf6b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:13.411385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66f14-4aa2-42cb-b842-1ea4f9fcdf6b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:13.417442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 665/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:13.419212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf88e-51ba-4244-9339-3839be7aa6dc None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:13.419691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf88e-51ba-4244-9339-3839be7aa6dc None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:13.419867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bf88e-51ba-4244-9339-3839be7aa6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:13.448142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4d9bf88e-51ba-4244-9339-3839be7aa6dc None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:13.449330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4d9bf88e-51ba-4244-9339-3839be7aa6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:13.527280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 680/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:13.563386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d66f14-4aa2-42cb-b842-1ea4f9fcdf6b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:13.577236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d66f14-4aa2-42cb-b842-1ea4f9fcdf6b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:13.580859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430cc0-a9bd-4c4a-a826-546c5fcc31d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:13.581498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430cc0-a9bd-4c4a-a826-546c5fcc31d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:13.581784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430cc0-a9bd-4c4a-a826-546c5fcc31d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:13.582069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430cc0-a9bd-4c4a-a826-546c5fcc31d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:13.591279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430cc0-a9bd-4c4a-a826-546c5fcc31d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:13.593363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430cc0-a9bd-4c4a-a826-546c5fcc31d6 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:13.605283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 666/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:17.930181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3a91-8017-4d54-8692-4411b37ca56e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:17.930701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3a91-8017-4d54-8692-4411b37ca56e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:17.930816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea3a91-8017-4d54-8692-4411b37ca56e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:17.932610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 681/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:17.938294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb000-e12a-4102-8855-94d33e90070f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:17.938702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb000-e12a-4102-8855-94d33e90070f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:17.938870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb000-e12a-4102-8855-94d33e90070f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:17.957045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9dedb000-e12a-4102-8855-94d33e90070f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:17.958213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9dedb000-e12a-4102-8855-94d33e90070f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:17.965977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 667/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:50:18.003180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea3a91-8017-4d54-8692-4411b37ca56e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:18.013681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea3a91-8017-4d54-8692-4411b37ca56e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:18.017226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec875fe-1424-48d5-8343-0780fde1e42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:18.017859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec875fe-1424-48d5-8343-0780fde1e42c service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:18.018144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec875fe-1424-48d5-8343-0780fde1e42c service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:18.018422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec875fe-1424-48d5-8343-0780fde1e42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:18.027184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec875fe-1424-48d5-8343-0780fde1e42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:18.028652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec875fe-1424-48d5-8343-0780fde1e42c service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:18.038355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 682/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:23.412576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7df04-da65-4185-af9e-f54298f656da None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:23.413087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7df04-da65-4185-af9e-f54298f656da None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:23.413178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7df04-da65-4185-af9e-f54298f656da None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:23.414867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 668/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 15:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:23.420229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985460-5e25-43df-a855-601b0794b89b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:23.421020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985460-5e25-43df-a855-601b0794b89b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:23.421558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985460-5e25-43df-a855-601b0794b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:23.494326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f2985460-5e25-43df-a855-601b0794b89b None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:23.495867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f2985460-5e25-43df-a855-601b0794b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:23.585090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 683/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 15:50:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:28.020548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ddc0-4f55-4f57-9bba-09b9809eef2e None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:28.021533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ddc0-4f55-4f57-9bba-09b9809eef2e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:28.021812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ddc0-4f55-4f57-9bba-09b9809eef2e None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:28.024381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 669/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 15:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:28.029492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad6a9-3801-4a4e-88e0-19949f60107a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:28.029935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad6a9-3801-4a4e-88e0-19949f60107a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:28.030121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ad6a9-3801-4a4e-88e0-19949f60107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:28.049671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b37ad6a9-3801-4a4e-88e0-19949f60107a None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:28.051042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b37ad6a9-3801-4a4e-88e0-19949f60107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:28.060977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 684/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 15:50:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:50:29.733985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacd692-9c07-4d13-ac74-0f146fbd985b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:29.734541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacd692-9c07-4d13-ac74-0f146fbd985b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:29.734541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacd692-9c07-4d13-ac74-0f146fbd985b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:29.736299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 670/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:29.741212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe753-db96-4f43-ae91-9739096c1b6d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:29.741694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe753-db96-4f43-ae91-9739096c1b6d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:29.741926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfe753-db96-4f43-ae91-9739096c1b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:29.760993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-49bfe753-db96-4f43-ae91-9739096c1b6d None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:29.762417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-49bfe753-db96-4f43-ae91-9739096c1b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:29.771444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 685/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 15:50:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:33.504134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79956-25d0-478e-b2e9-f3792073959b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:33.504680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79956-25d0-478e-b2e9-f3792073959b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:33.504680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a79956-25d0-478e-b2e9-f3792073959b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:33.506846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 671/1356] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:33.511901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6426e83-29a1-4916-b1b0-0b46c41f2d2c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:33.512727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6426e83-29a1-4916-b1b0-0b46c41f2d2c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:33.512991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6426e83-29a1-4916-b1b0-0b46c41f2d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:33.531926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d6426e83-29a1-4916-b1b0-0b46c41f2d2c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:33.533602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d6426e83-29a1-4916-b1b0-0b46c41f2d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:33.545026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 686/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:33.597655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7df9f-083e-48d2-bf31-f1b35221e06a None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:33.597944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7df9f-083e-48d2-bf31-f1b35221e06a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:33.598245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7df9f-083e-48d2-bf31-f1b35221e06a None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:33.600310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 672/1358] 10.222.0.23 () {54 vars in 960 bytes} [Tue Mar 29 15:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:33.606291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93bbfd-043c-46a1-bccb-8e5b327f4f65 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:33.607375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93bbfd-043c-46a1-bccb-8e5b327f4f65 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:33.607817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93bbfd-043c-46a1-bccb-8e5b327f4f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:33.656537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3d93bbfd-043c-46a1-bccb-8e5b327f4f65 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:33.657818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3d93bbfd-043c-46a1-bccb-8e5b327f4f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:33.742116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 687/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Mar 29 15:50:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:33.752278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7df9f-083e-48d2-bf31-f1b35221e06a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:33.767819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7df9f-083e-48d2-bf31-f1b35221e06a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:33.773463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101768e2-9e57-42ad-945c-1c4eb507dd12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:33.774190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101768e2-9e57-42ad-945c-1c4eb507dd12 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:33.774542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101768e2-9e57-42ad-945c-1c4eb507dd12 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:33.774884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101768e2-9e57-42ad-945c-1c4eb507dd12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:33.784294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101768e2-9e57-42ad-945c-1c4eb507dd12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:33.786023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101768e2-9e57-42ad-945c-1c4eb507dd12 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:33.797683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 673/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:36.441092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573726-aa2f-44b0-acec-143396931527 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:36.441540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573726-aa2f-44b0-acec-143396931527 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:36.441618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee573726-aa2f-44b0-acec-143396931527 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:36.443584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 688/1361] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:36.449240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c72aa-c568-4a26-8b1f-22bc843be057 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:36.449766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c72aa-c568-4a26-8b1f-22bc843be057 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:36.450655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c72aa-c568-4a26-8b1f-22bc843be057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:36.470819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-538c72aa-c568-4a26-8b1f-22bc843be057 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:36.472018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-538c72aa-c568-4a26-8b1f-22bc843be057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:36.482592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 674/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:36.529477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573726-aa2f-44b0-acec-143396931527 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:36.544269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee573726-aa2f-44b0-acec-143396931527 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:36.549874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a705-e9e4-4b9f-8215-4c6707014ffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:36.550955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a705-e9e4-4b9f-8215-4c6707014ffd service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:36.551190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a705-e9e4-4b9f-8215-4c6707014ffd service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:36.551811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a705-e9e4-4b9f-8215-4c6707014ffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:36.560596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a705-e9e4-4b9f-8215-4c6707014ffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:36.562260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a705-e9e4-4b9f-8215-4c6707014ffd service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:36.571888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 689/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:39.245142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac370ef-3d08-497f-aa7a-7c39e106458f None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:39.245707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac370ef-3d08-497f-aa7a-7c39e106458f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:39.245707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac370ef-3d08-497f-aa7a-7c39e106458f None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:39.248038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 675/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:39.253340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b16d5-7923-490f-922c-8950870c9991 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:39.253797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b16d5-7923-490f-922c-8950870c9991 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:39.253972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b16d5-7923-490f-922c-8950870c9991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:39.272705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5b6b16d5-7923-490f-922c-8950870c9991 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:39.273893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5b6b16d5-7923-490f-922c-8950870c9991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:39.281718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 690/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:39.327976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c6e4-6920-4581-8f62-fb9302d601d0 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:39.328270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c6e4-6920-4581-8f62-fb9302d601d0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:39.328549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7c6e4-6920-4581-8f62-fb9302d601d0 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:39.332005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 676/1366] 10.222.0.23 () {54 vars in 960 bytes} [Tue Mar 29 15:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:39.340233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff2f4-b71e-4b65-a6c6-3d2b0a0494c7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:39.340772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff2f4-b71e-4b65-a6c6-3d2b0a0494c7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:39.341295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff2f4-b71e-4b65-a6c6-3d2b0a0494c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:39.361440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-270ff2f4-b71e-4b65-a6c6-3d2b0a0494c7 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:39.362968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-270ff2f4-b71e-4b65-a6c6-3d2b0a0494c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:39.374591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 691/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Mar 29 15:50:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:39.383228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c6e4-6920-4581-8f62-fb9302d601d0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:39.398654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7c6e4-6920-4581-8f62-fb9302d601d0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:39.404543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b063ea8-40b9-4ab8-af69-b7a61ea65e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:39.405324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063ea8-40b9-4ab8-af69-b7a61ea65e40 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:39.405466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063ea8-40b9-4ab8-af69-b7a61ea65e40 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:39.406028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b063ea8-40b9-4ab8-af69-b7a61ea65e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:39.415279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b063ea8-40b9-4ab8-af69-b7a61ea65e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:39.417186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b063ea8-40b9-4ab8-af69-b7a61ea65e40 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:39.435738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 677/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:41.823584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746679-f101-4543-817f-06402f746515 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:41.824791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746679-f101-4543-817f-06402f746515 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:41.825069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746679-f101-4543-817f-06402f746515 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:41.826151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3520-9076-4dab-a77b-7481a117ba5c None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:41.826913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3520-9076-4dab-a77b-7481a117ba5c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:41.827232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 692/1369] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:41.827553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3520-9076-4dab-a77b-7481a117ba5c None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:41.829321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 678/1370] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:50:41.832265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:41.832811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:41.833330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:41.834438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcc8ee-52e9-40aa-b038-320b32e7155c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:41.834731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcc8ee-52e9-40aa-b038-320b32e7155c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:41.835005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcc8ee-52e9-40aa-b038-320b32e7155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:41.851814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:41.853033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:41.853908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a6bcc8ee-52e9-40aa-b038-320b32e7155c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:41.855060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a6bcc8ee-52e9-40aa-b038-320b32e7155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:41.862146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 693/1371] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:41.864886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 679/1372] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:50:41.906482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:41.919930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae067b9-0443-4ca1-bcc0-2c5a3589f676 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:41.925631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150301c8-0456-4acb-8944-69e1d58b7f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:41.926285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150301c8-0456-4acb-8944-69e1d58b7f73 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:41.926569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150301c8-0456-4acb-8944-69e1d58b7f73 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:41.926845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150301c8-0456-4acb-8944-69e1d58b7f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:41.936071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150301c8-0456-4acb-8944-69e1d58b7f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:41.937704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150301c8-0456-4acb-8944-69e1d58b7f73 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:41.947950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 694/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:42.166902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0f3a2-793f-4acb-b371-774162c51127 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:42.167345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0f3a2-793f-4acb-b371-774162c51127 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:42.167768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0f3a2-793f-4acb-b371-774162c51127 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:42.169955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 680/1374] 10.222.0.23 () {54 vars in 962 bytes} [Tue Mar 29 15:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:42.175383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeba2de-9701-4e0a-b98f-bbbbf2bf4967 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:42.175853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeba2de-9701-4e0a-b98f-bbbbf2bf4967 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:42.176235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeba2de-9701-4e0a-b98f-bbbbf2bf4967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:42.227004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0eeba2de-9701-4e0a-b98f-bbbbf2bf4967 None None] MFA Rules not processed for user `f956c2a9dfbd40fbabd043c371e579e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:42.228458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0eeba2de-9701-4e0a-b98f-bbbbf2bf4967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:42.292472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 695/1375] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Mar 29 15:50:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:42.296032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0f3a2-793f-4acb-b371-774162c51127 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:42.307179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0f3a2-793f-4acb-b371-774162c51127 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:42.311264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040ca8c-b734-4c23-9b09-4666d1671cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:42.311970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040ca8c-b734-4c23-9b09-4666d1671cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:42.312222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040ca8c-b734-4c23-9b09-4666d1671cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:42.312499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040ca8c-b734-4c23-9b09-4666d1671cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:42.321734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040ca8c-b734-4c23-9b09-4666d1671cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:42.323161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040ca8c-b734-4c23-9b09-4666d1671cb6 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:42.333576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 681/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:44.297438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5d9d1-cc74-483c-9c03-e22565468821 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:44.297936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5d9d1-cc74-483c-9c03-e22565468821 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:44.297936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5d9d1-cc74-483c-9c03-e22565468821 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:44.299994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 696/1377] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:44.305161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac2ea-445a-4cbe-8690-141c98be116d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:44.305590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac2ea-445a-4cbe-8690-141c98be116d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:44.305710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ac2ea-445a-4cbe-8690-141c98be116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:44.323999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-736ac2ea-445a-4cbe-8690-141c98be116d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:44.325865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-736ac2ea-445a-4cbe-8690-141c98be116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:44.333899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 682/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:44.377281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5d9d1-cc74-483c-9c03-e22565468821 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:44.391710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5d9d1-cc74-483c-9c03-e22565468821 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:44.397137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1467d-5a9f-4c17-a76f-4903bb386710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:44.397800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1467d-5a9f-4c17-a76f-4903bb386710 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:44.398081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1467d-5a9f-4c17-a76f-4903bb386710 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:44.398352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1467d-5a9f-4c17-a76f-4903bb386710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:44.407092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1467d-5a9f-4c17-a76f-4903bb386710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:44.408698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1467d-5a9f-4c17-a76f-4903bb386710 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:44.418417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 697/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:46.776990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ca79d-7a0e-4a7f-a6e8-a3b9017ffe29 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:46.777431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ca79d-7a0e-4a7f-a6e8-a3b9017ffe29 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:46.778081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ca79d-7a0e-4a7f-a6e8-a3b9017ffe29 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:46.779856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 683/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:46.785023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4541-3179-4ec5-b373-baac1ec2a32c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:46.785449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4541-3179-4ec5-b373-baac1ec2a32c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:46.785602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b4541-3179-4ec5-b373-baac1ec2a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:46.803034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5c6b4541-3179-4ec5-b373-baac1ec2a32c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:46.804253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5c6b4541-3179-4ec5-b373-baac1ec2a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:46.812378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 698/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:46.856592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ca79d-7a0e-4a7f-a6e8-a3b9017ffe29 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:46.871319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ca79d-7a0e-4a7f-a6e8-a3b9017ffe29 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:46.876739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42e4a5-2928-4476-b4ac-58c0ef598c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:46.877552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42e4a5-2928-4476-b4ac-58c0ef598c6b service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:46.877843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42e4a5-2928-4476-b4ac-58c0ef598c6b service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:46.878118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42e4a5-2928-4476-b4ac-58c0ef598c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:46.885918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42e4a5-2928-4476-b4ac-58c0ef598c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:46.888153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42e4a5-2928-4476-b4ac-58c0ef598c6b service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:46.897152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 684/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:50:49.247638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda59f-3406-4a2d-8920-a4abcc2aedf0 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:49.248218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda59f-3406-4a2d-8920-a4abcc2aedf0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:49.248218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfda59f-3406-4a2d-8920-a4abcc2aedf0 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:49.249943 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 699/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:49.255034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7601-c68b-41da-926f-a650c2fcc03a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:49.255840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7601-c68b-41da-926f-a650c2fcc03a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:49.256279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc7601-c68b-41da-926f-a650c2fcc03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:49.274226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b5cc7601-c68b-41da-926f-a650c2fcc03a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:49.275651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b5cc7601-c68b-41da-926f-a650c2fcc03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:49.284008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 685/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:49.326978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfda59f-3406-4a2d-8920-a4abcc2aedf0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:49.342043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfda59f-3406-4a2d-8920-a4abcc2aedf0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:49.347695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcbcf8-7d03-4fe8-a36b-53d28ba012fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:49.348443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcbcf8-7d03-4fe8-a36b-53d28ba012fc service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:49.348871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcbcf8-7d03-4fe8-a36b-53d28ba012fc service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:49.349259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcbcf8-7d03-4fe8-a36b-53d28ba012fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:49.357816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcbcf8-7d03-4fe8-a36b-53d28ba012fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:49.359590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcbcf8-7d03-4fe8-a36b-53d28ba012fc service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:49.369235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 700/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:51.693359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a983-ce6d-49fb-8b70-9e4917545f3b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:51.694097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a983-ce6d-49fb-8b70-9e4917545f3b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:51.694097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a983-ce6d-49fb-8b70-9e4917545f3b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:51.695756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 686/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:51.701978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5129fc-4e07-4a7d-8ab0-39d7098ed154 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:51.702409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5129fc-4e07-4a7d-8ab0-39d7098ed154 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:51.702551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5129fc-4e07-4a7d-8ab0-39d7098ed154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:51.720424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0d5129fc-4e07-4a7d-8ab0-39d7098ed154 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:51.721612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0d5129fc-4e07-4a7d-8ab0-39d7098ed154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:51.729376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 701/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:51.775156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567a983-ce6d-49fb-8b70-9e4917545f3b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:51.790004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567a983-ce6d-49fb-8b70-9e4917545f3b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:51.795596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884015e-72ed-4dd5-9aa7-80266465e6d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:51.796219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884015e-72ed-4dd5-9aa7-80266465e6d6 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:51.796503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884015e-72ed-4dd5-9aa7-80266465e6d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:51.796779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884015e-72ed-4dd5-9aa7-80266465e6d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:51.804872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884015e-72ed-4dd5-9aa7-80266465e6d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:51.806454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884015e-72ed-4dd5-9aa7-80266465e6d6 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:51.816463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 687/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:54.432478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f8230-c9cf-4f05-bfc3-1e8dcaf7e218 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:54.433005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f8230-c9cf-4f05-bfc3-1e8dcaf7e218 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:54.433709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f8230-c9cf-4f05-bfc3-1e8dcaf7e218 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:54.435671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 702/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:54.441136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7357-da23-481c-a1dc-3c2b7801804f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:54.441581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7357-da23-481c-a1dc-3c2b7801804f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:54.441674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe7357-da23-481c-a1dc-3c2b7801804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:54.459280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b3fe7357-da23-481c-a1dc-3c2b7801804f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:54.460535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b3fe7357-da23-481c-a1dc-3c2b7801804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:54.468377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 688/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:50:54.514111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f8230-c9cf-4f05-bfc3-1e8dcaf7e218 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:54.528645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f8230-c9cf-4f05-bfc3-1e8dcaf7e218 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:54.534139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aac21-dc87-4b1a-83b1-a0df5652f5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:54.534770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aac21-dc87-4b1a-83b1-a0df5652f5ad service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:54.535080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aac21-dc87-4b1a-83b1-a0df5652f5ad service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:54.535346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aac21-dc87-4b1a-83b1-a0df5652f5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:54.544313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aac21-dc87-4b1a-83b1-a0df5652f5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:54.545919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aac21-dc87-4b1a-83b1-a0df5652f5ad service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:54.555507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 703/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:56.882390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fb760-9e73-4c0f-915e-ca4aaaf8f4c8 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:56.883123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fb760-9e73-4c0f-915e-ca4aaaf8f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:56.883123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fb760-9e73-4c0f-915e-ca4aaaf8f4c8 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:56.884709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 689/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:56.890253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdc6a5-dc9f-4caf-9b3e-89d73eb380d1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:56.890704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdc6a5-dc9f-4caf-9b3e-89d73eb380d1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:56.890798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdc6a5-dc9f-4caf-9b3e-89d73eb380d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:56.908312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ddcdc6a5-dc9f-4caf-9b3e-89d73eb380d1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:56.909513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ddcdc6a5-dc9f-4caf-9b3e-89d73eb380d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:56.917835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 704/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:56.961484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fb760-9e73-4c0f-915e-ca4aaaf8f4c8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:56.976581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fb760-9e73-4c0f-915e-ca4aaaf8f4c8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:56.981987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6346e2-317c-4eac-bcbe-20528f880906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:56.982618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6346e2-317c-4eac-bcbe-20528f880906 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:56.982901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6346e2-317c-4eac-bcbe-20528f880906 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:56.983176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6346e2-317c-4eac-bcbe-20528f880906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:56.991331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6346e2-317c-4eac-bcbe-20528f880906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:56.992952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6346e2-317c-4eac-bcbe-20528f880906 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:57.002802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 690/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:58.245308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce4cc3-fc09-4b94-920d-2ca2c71bae68 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:58.245836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce4cc3-fc09-4b94-920d-2ca2c71bae68 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:58.245948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce4cc3-fc09-4b94-920d-2ca2c71bae68 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:58.247689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 705/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:58.252825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f6e1-867c-454c-9f18-0dd7ee5bccc3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:58.253262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f6e1-867c-454c-9f18-0dd7ee5bccc3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:58.253375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f6e1-867c-454c-9f18-0dd7ee5bccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:58.271555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d436f6e1-867c-454c-9f18-0dd7ee5bccc3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:58.272863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d436f6e1-867c-454c-9f18-0dd7ee5bccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:58.281290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 691/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:58.336835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6701691-af45-4f4b-993e-e1469c7c1043 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:58.337125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6701691-af45-4f4b-993e-e1469c7c1043 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:58.337405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6701691-af45-4f4b-993e-e1469c7c1043 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:58.339187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 706/1397] 10.222.0.23 () {54 vars in 961 bytes} [Tue Mar 29 15:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:58.344824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466ac5-8719-4f86-a8c5-34319d5e8f87 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:58.345113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466ac5-8719-4f86-a8c5-34319d5e8f87 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:58.345425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466ac5-8719-4f86-a8c5-34319d5e8f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:58.392581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ac466ac5-8719-4f86-a8c5-34319d5e8f87 None None] MFA Rules not processed for user `6b029906da704309ad9b8da03b51c054`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:58.393796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ac466ac5-8719-4f86-a8c5-34319d5e8f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:58.463933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 692/1398] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Mar 29 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:58.471552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6701691-af45-4f4b-993e-e1469c7c1043 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:58.482045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6701691-af45-4f4b-993e-e1469c7c1043 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:58.485525 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ffabd-f949-44b1-b4fb-321c1de89df8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:58.486178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ffabd-f949-44b1-b4fb-321c1de89df8 service glance] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:58.486462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ffabd-f949-44b1-b4fb-321c1de89df8 service glance] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:58.486738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ffabd-f949-44b1-b4fb-321c1de89df8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:58.496122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ffabd-f949-44b1-b4fb-321c1de89df8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:58.497496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ffabd-f949-44b1-b4fb-321c1de89df8 service glance] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:58.506817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 707/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:50:58.923965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada1fc4-a268-4eb6-ac35-ad97692e6f45 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:58.924262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada1fc4-a268-4eb6-ac35-ad97692e6f45 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:58.924545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada1fc4-a268-4eb6-ac35-ad97692e6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:58.972787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2ada1fc4-a268-4eb6-ac35-ad97692e6f45 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:58.974014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2ada1fc4-a268-4eb6-ac35-ad97692e6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:59.041976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 693/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:50:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:59.086833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e4b2-fe98-4344-9510-dd0160518031 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:59.087128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e4b2-fe98-4344-9510-dd0160518031 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:59.087411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e4b2-fe98-4344-9510-dd0160518031 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:59.089402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 708/1401] 10.222.0.23 () {54 vars in 942 bytes} [Tue Mar 29 15:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:59.095841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dbadc-0c67-4f8d-9de3-719cc5a8d1be None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:59.096182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dbadc-0c67-4f8d-9de3-719cc5a8d1be None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:59.096487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dbadc-0c67-4f8d-9de3-719cc5a8d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:59.144685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e02dbadc-0c67-4f8d-9de3-719cc5a8d1be None None] MFA Rules not processed for user `7152e01448494ebd98eb204c3e602a77`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:59.145733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e02dbadc-0c67-4f8d-9de3-719cc5a8d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:59.217801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 694/1402] 10.222.0.23 () {58 vars in 1039 bytes} [Tue Mar 29 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:59.227090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e4b2-fe98-4344-9510-dd0160518031 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:59.240374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e4b2-fe98-4344-9510-dd0160518031 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:59.245203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2df1f6-54da-4cba-8ee7-51c305fb7d8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:59.246334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2df1f6-54da-4cba-8ee7-51c305fb7d8c service swift] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:59.246618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2df1f6-54da-4cba-8ee7-51c305fb7d8c service swift] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:59.246896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2df1f6-54da-4cba-8ee7-51c305fb7d8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:59.254591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2df1f6-54da-4cba-8ee7-51c305fb7d8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:59.256249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2df1f6-54da-4cba-8ee7-51c305fb7d8c service swift] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:59.264673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 709/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 15:50:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 15:50:59.368673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34564-a8bb-4136-b653-b2d3d7afb41f None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:59.369150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34564-a8bb-4136-b653-b2d3d7afb41f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:59.369248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c34564-a8bb-4136-b653-b2d3d7afb41f None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:59.371725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 695/1404] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:50:59.376984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b191-f30e-4b80-a46a-b9486d867c02 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:59.377495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b191-f30e-4b80-a46a-b9486d867c02 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:59.377929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433b191-f30e-4b80-a46a-b9486d867c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:59.399647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7433b191-f30e-4b80-a46a-b9486d867c02 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:50:59.400855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7433b191-f30e-4b80-a46a-b9486d867c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:50:59.408980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 710/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:50:59.458607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34564-a8bb-4136-b653-b2d3d7afb41f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:50:59.473221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c34564-a8bb-4136-b653-b2d3d7afb41f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:50:59.479162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7cc261-b256-4b3e-8d3c-6634b54918e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:50:59.480389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc261-b256-4b3e-8d3c-6634b54918e5 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:50:59.480667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc261-b256-4b3e-8d3c-6634b54918e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:50:59.481000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7cc261-b256-4b3e-8d3c-6634b54918e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:50:59.492078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc261-b256-4b3e-8d3c-6634b54918e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:50:59.493673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7cc261-b256-4b3e-8d3c-6634b54918e5 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:50:59.507774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 696/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:01.977557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7ec5-7bf4-4de6-8a60-6326c1d301ba None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:01.978189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7ec5-7bf4-4de6-8a60-6326c1d301ba None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:01.978189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad7ec5-7bf4-4de6-8a60-6326c1d301ba None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:01.980699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 711/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:01.988378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb119-3216-4eec-b3b6-6ff7d2687a59 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:01.988958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb119-3216-4eec-b3b6-6ff7d2687a59 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:01.989562 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb119-3216-4eec-b3b6-6ff7d2687a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:02.014193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-abbcb119-3216-4eec-b3b6-6ff7d2687a59 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:02.015476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-abbcb119-3216-4eec-b3b6-6ff7d2687a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:02.024168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 697/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:02.078135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7ec5-7bf4-4de6-8a60-6326c1d301ba None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:02.094740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad7ec5-7bf4-4de6-8a60-6326c1d301ba None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:02.100593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a707d-4dcf-459f-97a0-d349266470ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:02.101229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a707d-4dcf-459f-97a0-d349266470ab service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:02.101515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a707d-4dcf-459f-97a0-d349266470ab service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:02.101790 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a707d-4dcf-459f-97a0-d349266470ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:02.110862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a707d-4dcf-459f-97a0-d349266470ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:02.112852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a707d-4dcf-459f-97a0-d349266470ab service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:02.124804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 712/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:22.269484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f87760-275c-4f20-aa4d-0314bdd0fce2 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:22.276476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f87760-275c-4f20-aa4d-0314bdd0fce2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:22.276476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f87760-275c-4f20-aa4d-0314bdd0fce2 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:22.276476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 698/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue Mar 29 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:22.277526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0c42-e417-40cb-989b-0b7ba3f17982 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:22.277959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0c42-e417-40cb-989b-0b7ba3f17982 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:22.278087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0c42-e417-40cb-989b-0b7ba3f17982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:22.295817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-66ec0c42-e417-40cb-989b-0b7ba3f17982 None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:22.297020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-66ec0c42-e417-40cb-989b-0b7ba3f17982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:22.305402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 713/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Mar 29 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:22.318996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeea5e3-66ce-42ec-8d59-e798cd42992f None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:22.319285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeea5e3-66ce-42ec-8d59-e798cd42992f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:22.319596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeea5e3-66ce-42ec-8d59-e798cd42992f None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:22.321318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 699/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue Mar 29 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:22.326704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b014d-6078-452c-89c6-caf27a30fde3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:22.326991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b014d-6078-452c-89c6-caf27a30fde3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:22.327267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b014d-6078-452c-89c6-caf27a30fde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:22.344931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a35b014d-6078-452c-89c6-caf27a30fde3 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:22.346074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a35b014d-6078-452c-89c6-caf27a30fde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:22.355078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 714/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Mar 29 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:25.088645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985beb91-fff7-4e6d-8bbe-a8b016ceb3f7 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:25.089296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985beb91-fff7-4e6d-8bbe-a8b016ceb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:25.089296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985beb91-fff7-4e6d-8bbe-a8b016ceb3f7 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:25.091239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:25.096771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db9fa-60d7-42f3-a875-37424f0c68b9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:25.097229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db9fa-60d7-42f3-a875-37424f0c68b9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:25.097325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db9fa-60d7-42f3-a875-37424f0c68b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:25.115360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3c3db9fa-60d7-42f3-a875-37424f0c68b9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:25.116571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3c3db9fa-60d7-42f3-a875-37424f0c68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:25.124573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:25.166054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985beb91-fff7-4e6d-8bbe-a8b016ceb3f7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:25.180383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985beb91-fff7-4e6d-8bbe-a8b016ceb3f7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:25.186119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c09f9-3879-47de-9375-79ece9678a52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:25.186751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c09f9-3879-47de-9375-79ece9678a52 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:25.187037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c09f9-3879-47de-9375-79ece9678a52 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:25.187318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c09f9-3879-47de-9375-79ece9678a52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:25.195257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c09f9-3879-47de-9375-79ece9678a52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:25.197658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c09f9-3879-47de-9375-79ece9678a52 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:25.206742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 701/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:26.561844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f734-e733-490c-a05c-1563f712638f None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:26.562394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f734-e733-490c-a05c-1563f712638f None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:26.562394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7f734-e733-490c-a05c-1563f712638f None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:26.564261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:26.569165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc6be4-fbfc-4725-9683-736972e6fa6b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:26.569550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc6be4-fbfc-4725-9683-736972e6fa6b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:26.569714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc6be4-fbfc-4725-9683-736972e6fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:26.588332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-98bc6be4-fbfc-4725-9683-736972e6fa6b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:26.589491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-98bc6be4-fbfc-4725-9683-736972e6fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:26.597126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:26.760165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7f734-e733-490c-a05c-1563f712638f None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:26.774483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7f734-e733-490c-a05c-1563f712638f None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:26.780515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c255-8f94-4f8a-a460-4cf4c0746811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:26.781137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c255-8f94-4f8a-a460-4cf4c0746811 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:26.781421 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c255-8f94-4f8a-a460-4cf4c0746811 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:26.781700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c255-8f94-4f8a-a460-4cf4c0746811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:26.789558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c255-8f94-4f8a-a460-4cf4c0746811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:26.791163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c255-8f94-4f8a-a460-4cf4c0746811 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:26.800200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 717/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:28.104353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb095a-8690-408f-9b6c-bb337e24213e None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:28.104894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb095a-8690-408f-9b6c-bb337e24213e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:28.104894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb095a-8690-408f-9b6c-bb337e24213e None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:28.106572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:28.111446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d38e7-149f-4ccd-a71b-48ba6fa4bd92 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:28.111916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d38e7-149f-4ccd-a71b-48ba6fa4bd92 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:28.112029 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d38e7-149f-4ccd-a71b-48ba6fa4bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:28.129822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1a0d38e7-149f-4ccd-a71b-48ba6fa4bd92 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:28.130989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1a0d38e7-149f-4ccd-a71b-48ba6fa4bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:28.138626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:28.285926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb095a-8690-408f-9b6c-bb337e24213e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:28.299988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb095a-8690-408f-9b6c-bb337e24213e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:28.305306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbfea7-9ce3-4662-953b-6cc412e9f07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:28.305929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfea7-9ce3-4662-953b-6cc412e9f07b service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:28.306214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfea7-9ce3-4662-953b-6cc412e9f07b service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:28.306494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbfea7-9ce3-4662-953b-6cc412e9f07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:28.314274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbfea7-9ce3-4662-953b-6cc412e9f07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:28.315870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbfea7-9ce3-4662-953b-6cc412e9f07b service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:28.325840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 704/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:29.615690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6b57-bf3f-4628-8553-8b79068a6453 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:29.616238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6b57-bf3f-4628-8553-8b79068a6453 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:29.616337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d6b57-bf3f-4628-8553-8b79068a6453 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:29.618048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:29.624223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d0b90-60b2-4af4-ad82-1453208f8c29 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:29.624676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d0b90-60b2-4af4-ad82-1453208f8c29 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:29.624784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d0b90-60b2-4af4-ad82-1453208f8c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:29.642344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1b2d0b90-60b2-4af4-ad82-1453208f8c29 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:29.643536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1b2d0b90-60b2-4af4-ad82-1453208f8c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:29.651220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:29.799620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6b57-bf3f-4628-8553-8b79068a6453 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:29.814299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d6b57-bf3f-4628-8553-8b79068a6453 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:29.819650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62175-9d48-4731-9194-d8bde0325b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:29.820282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62175-9d48-4731-9194-d8bde0325b05 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:29.820567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62175-9d48-4731-9194-d8bde0325b05 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:29.820846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62175-9d48-4731-9194-d8bde0325b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:29.829016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62175-9d48-4731-9194-d8bde0325b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:29.830596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62175-9d48-4731-9194-d8bde0325b05 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:29.840261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 720/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:31.149565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49aa5-db49-45ea-9cc1-0b4e6f24c599 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:31.150089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49aa5-db49-45ea-9cc1-0b4e6f24c599 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:31.150089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49aa5-db49-45ea-9cc1-0b4e6f24c599 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:31.151829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:31.156734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf5af-ee78-495e-9d0b-7f9e53cebb99 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:31.157130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf5af-ee78-495e-9d0b-7f9e53cebb99 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:31.157283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf5af-ee78-495e-9d0b-7f9e53cebb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:31.175095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-81baf5af-ee78-495e-9d0b-7f9e53cebb99 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:31.176293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-81baf5af-ee78-495e-9d0b-7f9e53cebb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:31.184776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:31.333893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b49aa5-db49-45ea-9cc1-0b4e6f24c599 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:31.348401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b49aa5-db49-45ea-9cc1-0b4e6f24c599 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:31.353882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f658a0-f13f-4cbe-8f06-43a5afc71e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:31.354499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f658a0-f13f-4cbe-8f06-43a5afc71e7a service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:31.354781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f658a0-f13f-4cbe-8f06-43a5afc71e7a service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:31.355056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f658a0-f13f-4cbe-8f06-43a5afc71e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:31.362844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f658a0-f13f-4cbe-8f06-43a5afc71e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:31.364491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f658a0-f13f-4cbe-8f06-43a5afc71e7a service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:31.374341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 707/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:32.625290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98cd33-6f08-4413-bcfb-c4359a53900c None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:32.625875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98cd33-6f08-4413-bcfb-c4359a53900c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:32.625875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98cd33-6f08-4413-bcfb-c4359a53900c None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:32.627657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:32.632497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1467-52be-4244-a059-2e3c1acc8d05 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:32.632948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1467-52be-4244-a059-2e3c1acc8d05 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:32.633075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d1467-52be-4244-a059-2e3c1acc8d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:32.650572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-756d1467-52be-4244-a059-2e3c1acc8d05 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:32.651721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-756d1467-52be-4244-a059-2e3c1acc8d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:32.659296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:51:32.809477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98cd33-6f08-4413-bcfb-c4359a53900c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:32.824169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98cd33-6f08-4413-bcfb-c4359a53900c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:32.829791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44388066-7b5d-4aaf-a3bf-2e1d57b6f12c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:32.830430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44388066-7b5d-4aaf-a3bf-2e1d57b6f12c service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:32.830718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44388066-7b5d-4aaf-a3bf-2e1d57b6f12c service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:32.830997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44388066-7b5d-4aaf-a3bf-2e1d57b6f12c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:32.839646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44388066-7b5d-4aaf-a3bf-2e1d57b6f12c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:32.841230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44388066-7b5d-4aaf-a3bf-2e1d57b6f12c service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:32.850264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 723/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:34.076240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae63a-e1a2-46ef-b3c0-592488aebf81 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:34.076765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae63a-e1a2-46ef-b3c0-592488aebf81 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:34.076765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae63a-e1a2-46ef-b3c0-592488aebf81 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:34.078521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:51:34.083549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0a262-26a0-406d-86d0-d740fb741098 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:34.083982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0a262-26a0-406d-86d0-d740fb741098 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:34.084084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0a262-26a0-406d-86d0-d740fb741098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:34.101796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-abf0a262-26a0-406d-86d0-d740fb741098 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:34.103507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-abf0a262-26a0-406d-86d0-d740fb741098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:34.111161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:34.260870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae63a-e1a2-46ef-b3c0-592488aebf81 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:34.275867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae63a-e1a2-46ef-b3c0-592488aebf81 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:34.281532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0b50-4a06-42a0-be24-ac491786b81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:34.282191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0b50-4a06-42a0-be24-ac491786b81b service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:34.282479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0b50-4a06-42a0-be24-ac491786b81b service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:34.282764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0b50-4a06-42a0-be24-ac491786b81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:34.292407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db0b50-4a06-42a0-be24-ac491786b81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:34.294026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db0b50-4a06-42a0-be24-ac491786b81b service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:34.304727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 710/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:35.541745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6c70-1347-4b1d-a87d-3eea642fc724 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:35.542312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6c70-1347-4b1d-a87d-3eea642fc724 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:35.542312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b6c70-1347-4b1d-a87d-3eea642fc724 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:35.544076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:35.548892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc922b-a542-4abc-922c-e0f520ecd23f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:35.549293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc922b-a542-4abc-922c-e0f520ecd23f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:35.549444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc922b-a542-4abc-922c-e0f520ecd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:35.567273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c5cc922b-a542-4abc-922c-e0f520ecd23f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:35.568473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c5cc922b-a542-4abc-922c-e0f520ecd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:35.576373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:35.726727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b6c70-1347-4b1d-a87d-3eea642fc724 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:35.740620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b6c70-1347-4b1d-a87d-3eea642fc724 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:35.745994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463fc0c-c769-4817-9254-564b91bb25e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:35.746628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fc0c-c769-4817-9254-564b91bb25e7 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:35.746919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fc0c-c769-4817-9254-564b91bb25e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:35.747198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463fc0c-c769-4817-9254-564b91bb25e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:35.755266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463fc0c-c769-4817-9254-564b91bb25e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:35.756880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463fc0c-c769-4817-9254-564b91bb25e7 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:35.766802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 726/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:37.016433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc56d-e5b2-45e3-bcbb-930d2f65fc88 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:37.016948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc56d-e5b2-45e3-bcbb-930d2f65fc88 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:37.016948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bc56d-e5b2-45e3-bcbb-930d2f65fc88 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:37.018704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:37.024240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280ca92-523e-4cb0-bb70-a98302d4cfad None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:37.024680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280ca92-523e-4cb0-bb70-a98302d4cfad None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:37.024775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280ca92-523e-4cb0-bb70-a98302d4cfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:37.045690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2280ca92-523e-4cb0-bb70-a98302d4cfad None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:37.046872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2280ca92-523e-4cb0-bb70-a98302d4cfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:37.054574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:37.203474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bc56d-e5b2-45e3-bcbb-930d2f65fc88 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:37.218114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bc56d-e5b2-45e3-bcbb-930d2f65fc88 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:37.227995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4a178-4e4c-49fc-92b4-7f2ecb2c5621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:37.228627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a178-4e4c-49fc-92b4-7f2ecb2c5621 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:37.228911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a178-4e4c-49fc-92b4-7f2ecb2c5621 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:37.229195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a178-4e4c-49fc-92b4-7f2ecb2c5621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:37.237713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4a178-4e4c-49fc-92b4-7f2ecb2c5621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:37.239279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4a178-4e4c-49fc-92b4-7f2ecb2c5621 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:37.248490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 713/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:39.437432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211120d0-c36c-4700-bbd5-8c11becbe3db None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:39.438014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211120d0-c36c-4700-bbd5-8c11becbe3db None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:39.438014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211120d0-c36c-4700-bbd5-8c11becbe3db None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:39.439809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:39.444932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d807e7-eb26-498a-ba75-c9b4fa87bf20 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:39.445338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d807e7-eb26-498a-ba75-c9b4fa87bf20 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:39.445500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d807e7-eb26-498a-ba75-c9b4fa87bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:39.464161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-73d807e7-eb26-498a-ba75-c9b4fa87bf20 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:39.465346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-73d807e7-eb26-498a-ba75-c9b4fa87bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:39.473175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:39.511574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211120d0-c36c-4700-bbd5-8c11becbe3db None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:39.521960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211120d0-c36c-4700-bbd5-8c11becbe3db None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:39.525470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf206f26-d6e9-4a72-b0eb-81f582dde8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:39.526095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf206f26-d6e9-4a72-b0eb-81f582dde8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:39.526381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf206f26-d6e9-4a72-b0eb-81f582dde8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:39.526658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf206f26-d6e9-4a72-b0eb-81f582dde8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:39.535270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf206f26-d6e9-4a72-b0eb-81f582dde8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:39.536737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf206f26-d6e9-4a72-b0eb-81f582dde8d6 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:39.546322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 729/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:41.970194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3e0c-2135-4d12-8a11-8e81a3c6bb56 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:41.970748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3e0c-2135-4d12-8a11-8e81a3c6bb56 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:41.970841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d3e0c-2135-4d12-8a11-8e81a3c6bb56 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:41.972589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:41.978522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd48ee9-6b10-410d-a810-3a92c2d12056 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:41.978949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd48ee9-6b10-410d-a810-3a92c2d12056 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:41.979110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd48ee9-6b10-410d-a810-3a92c2d12056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:41.996994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-dfd48ee9-6b10-410d-a810-3a92c2d12056 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:41.998167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-dfd48ee9-6b10-410d-a810-3a92c2d12056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:42.005861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:42.044326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3e0c-2135-4d12-8a11-8e81a3c6bb56 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:42.054775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d3e0c-2135-4d12-8a11-8e81a3c6bb56 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:42.058264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80f1a9-5619-47e1-97dd-d97a75698bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:42.058888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f1a9-5619-47e1-97dd-d97a75698bda service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:42.059175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f1a9-5619-47e1-97dd-d97a75698bda service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:42.059647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f1a9-5619-47e1-97dd-d97a75698bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:42.068250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f1a9-5619-47e1-97dd-d97a75698bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:42.069704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f1a9-5619-47e1-97dd-d97a75698bda service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:42.079295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 716/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:44.654261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8155a2-cbd1-4b4d-9542-dccb397afc9a None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:44.654825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8155a2-cbd1-4b4d-9542-dccb397afc9a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:44.654825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8155a2-cbd1-4b4d-9542-dccb397afc9a None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:44.656554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:44.661778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b6c6-138b-4211-b49a-a64e03deab6d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:44.662209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b6c6-138b-4211-b49a-a64e03deab6d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:44.662314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157b6c6-138b-4211-b49a-a64e03deab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:44.680877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8157b6c6-138b-4211-b49a-a64e03deab6d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:44.682058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8157b6c6-138b-4211-b49a-a64e03deab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:44.689730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:44.727911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8155a2-cbd1-4b4d-9542-dccb397afc9a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:44.738139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8155a2-cbd1-4b4d-9542-dccb397afc9a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:44.741565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e6638-2b71-4b61-ba31-0ed473c39d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:44.742729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e6638-2b71-4b61-ba31-0ed473c39d98 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:44.743014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e6638-2b71-4b61-ba31-0ed473c39d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:44.743287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e6638-2b71-4b61-ba31-0ed473c39d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:44.752000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e6638-2b71-4b61-ba31-0ed473c39d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:44.753419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e6638-2b71-4b61-ba31-0ed473c39d98 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:44.762619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 732/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:47.173434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2a29-8fa0-4109-98b9-4e2c5bd23d43 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:47.173965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2a29-8fa0-4109-98b9-4e2c5bd23d43 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:47.173965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2a29-8fa0-4109-98b9-4e2c5bd23d43 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:47.175701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:47.180946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a9fb1-2654-41d5-9cc5-8b1269b2401f None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:47.181364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a9fb1-2654-41d5-9cc5-8b1269b2401f None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:47.181503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a9fb1-2654-41d5-9cc5-8b1269b2401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:47.199358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c66a9fb1-2654-41d5-9cc5-8b1269b2401f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:47.200586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c66a9fb1-2654-41d5-9cc5-8b1269b2401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:47.208334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:47.246713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2a29-8fa0-4109-98b9-4e2c5bd23d43 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:47.257182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2a29-8fa0-4109-98b9-4e2c5bd23d43 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:47.260635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d435f93-5a95-4cd6-8e55-ce380e75f8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:47.261255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435f93-5a95-4cd6-8e55-ce380e75f8cd service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:47.261538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435f93-5a95-4cd6-8e55-ce380e75f8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:47.261812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435f93-5a95-4cd6-8e55-ce380e75f8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:47.270396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d435f93-5a95-4cd6-8e55-ce380e75f8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:47.271829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d435f93-5a95-4cd6-8e55-ce380e75f8cd service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:47.281267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 719/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:49.589963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9def631-699b-43a2-8df6-ef4155f7adfa None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:49.590543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9def631-699b-43a2-8df6-ef4155f7adfa None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:49.590543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9def631-699b-43a2-8df6-ef4155f7adfa None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:49.592386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:49.597430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b24fd-b8f1-466d-b7c4-42856a9ee9af None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:49.597858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b24fd-b8f1-466d-b7c4-42856a9ee9af None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:49.597989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b24fd-b8f1-466d-b7c4-42856a9ee9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:49.615749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-078b24fd-b8f1-466d-b7c4-42856a9ee9af None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:49.617495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-078b24fd-b8f1-466d-b7c4-42856a9ee9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:49.625094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:49.662526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9def631-699b-43a2-8df6-ef4155f7adfa None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:49.673470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9def631-699b-43a2-8df6-ef4155f7adfa None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:49.676922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9cea3-e7b1-4c9b-87c8-97a567bdaa72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:49.677545 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9cea3-e7b1-4c9b-87c8-97a567bdaa72 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:49.677831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9cea3-e7b1-4c9b-87c8-97a567bdaa72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:49.678109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9cea3-e7b1-4c9b-87c8-97a567bdaa72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:49.687516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9cea3-e7b1-4c9b-87c8-97a567bdaa72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:49.689093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9cea3-e7b1-4c9b-87c8-97a567bdaa72 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:49.699127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 735/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:52.040903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538100fc-112b-47ca-8a29-bc4031c56c46 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:52.041426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538100fc-112b-47ca-8a29-bc4031c56c46 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:52.041426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538100fc-112b-47ca-8a29-bc4031c56c46 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:52.043116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:52.048393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facd85-79b5-43f8-b9ab-5b48f9b40d1e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:52.048797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facd85-79b5-43f8-b9ab-5b48f9b40d1e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:52.048953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0facd85-79b5-43f8-b9ab-5b48f9b40d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:52.066061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d0facd85-79b5-43f8-b9ab-5b48f9b40d1e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:52.067234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d0facd85-79b5-43f8-b9ab-5b48f9b40d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:52.075665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:52.113095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538100fc-112b-47ca-8a29-bc4031c56c46 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:52.123393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538100fc-112b-47ca-8a29-bc4031c56c46 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:52.126864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51ed43-5674-49f3-b8ed-ba102dad6fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:52.127483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51ed43-5674-49f3-b8ed-ba102dad6fbd service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:52.127786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51ed43-5674-49f3-b8ed-ba102dad6fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:52.128056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51ed43-5674-49f3-b8ed-ba102dad6fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:52.136955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51ed43-5674-49f3-b8ed-ba102dad6fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:52.138359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51ed43-5674-49f3-b8ed-ba102dad6fbd service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:52.147263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 722/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:54.570735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be720f-1602-4e2f-a75a-6e02a1cdf40e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:54.571563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be720f-1602-4e2f-a75a-6e02a1cdf40e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:54.571563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be720f-1602-4e2f-a75a-6e02a1cdf40e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:54.573323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:54.578439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80b00-c9f5-4a07-a111-be25201e4015 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:54.578877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80b00-c9f5-4a07-a111-be25201e4015 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:54.578973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80b00-c9f5-4a07-a111-be25201e4015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:54.596787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-eda80b00-c9f5-4a07-a111-be25201e4015 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:54.597961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-eda80b00-c9f5-4a07-a111-be25201e4015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:54.606003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:51:54.643259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be720f-1602-4e2f-a75a-6e02a1cdf40e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:54.654105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be720f-1602-4e2f-a75a-6e02a1cdf40e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:54.657691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b4a57-d74d-4946-a852-5aee70094d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:54.658259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b4a57-d74d-4946-a852-5aee70094d32 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:54.658538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b4a57-d74d-4946-a852-5aee70094d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:54.658812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b4a57-d74d-4946-a852-5aee70094d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:54.667930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b4a57-d74d-4946-a852-5aee70094d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:54.669344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b4a57-d74d-4946-a852-5aee70094d32 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:54.678233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 738/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:51:56.970415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43d01-a889-4c76-8bb7-3fcd8ae96e0b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:56.970967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43d01-a889-4c76-8bb7-3fcd8ae96e0b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:56.970967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b43d01-a889-4c76-8bb7-3fcd8ae96e0b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:56.972726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:51:56.978620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d8f3-ab9b-41fc-8b62-83debc81ad46 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:56.979100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d8f3-ab9b-41fc-8b62-83debc81ad46 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:56.979205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d8f3-ab9b-41fc-8b62-83debc81ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:56.997369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9eb5d8f3-ab9b-41fc-8b62-83debc81ad46 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:56.998559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9eb5d8f3-ab9b-41fc-8b62-83debc81ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:57.006243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:57.043267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43d01-a889-4c76-8bb7-3fcd8ae96e0b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:57.053843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b43d01-a889-4c76-8bb7-3fcd8ae96e0b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:57.057357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b846df-8728-4656-b54d-b01ff86f9dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:57.057981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b846df-8728-4656-b54d-b01ff86f9dae service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:57.058267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b846df-8728-4656-b54d-b01ff86f9dae service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:57.058546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b846df-8728-4656-b54d-b01ff86f9dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:57.067328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b846df-8728-4656-b54d-b01ff86f9dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:57.068818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b846df-8728-4656-b54d-b01ff86f9dae service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:57.078135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 725/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:51:59.341872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141afe5f-4440-4033-97c5-454c0d9b9763 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:59.342436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141afe5f-4440-4033-97c5-454c0d9b9763 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:59.342436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141afe5f-4440-4033-97c5-454c0d9b9763 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:59.344248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:51:59.349288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168c78f-2ace-4421-a136-ac0a18646f0c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:59.349730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168c78f-2ace-4421-a136-ac0a18646f0c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:59.349867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168c78f-2ace-4421-a136-ac0a18646f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:59.368054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8168c78f-2ace-4421-a136-ac0a18646f0c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:51:59.369234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8168c78f-2ace-4421-a136-ac0a18646f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:51:59.377045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:51:59.414172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141afe5f-4440-4033-97c5-454c0d9b9763 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:51:59.424636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141afe5f-4440-4033-97c5-454c0d9b9763 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:51:59.428112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be0d63-e287-45a5-a002-e2ce31e1ef97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:51:59.429240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be0d63-e287-45a5-a002-e2ce31e1ef97 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:51:59.429527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be0d63-e287-45a5-a002-e2ce31e1ef97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:51:59.429804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be0d63-e287-45a5-a002-e2ce31e1ef97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:51:59.438623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be0d63-e287-45a5-a002-e2ce31e1ef97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:51:59.440087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be0d63-e287-45a5-a002-e2ce31e1ef97 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:51:59.449883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 741/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:01.740740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e335e-5cab-45ea-abfe-f824c07cf3e1 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:01.741356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e335e-5cab-45ea-abfe-f824c07cf3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:01.741356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e335e-5cab-45ea-abfe-f824c07cf3e1 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:01.743109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:01.748443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb66a85-1d03-4c53-a201-28526c513736 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:01.748898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb66a85-1d03-4c53-a201-28526c513736 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:01.749007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb66a85-1d03-4c53-a201-28526c513736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:01.767214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-edb66a85-1d03-4c53-a201-28526c513736 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:01.768455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-edb66a85-1d03-4c53-a201-28526c513736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:01.780322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:01.818144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e335e-5cab-45ea-abfe-f824c07cf3e1 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:01.829520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e335e-5cab-45ea-abfe-f824c07cf3e1 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:01.833016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4d85c-52ed-439b-8554-afbce02cf535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:01.833645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d85c-52ed-439b-8554-afbce02cf535 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:01.833927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d85c-52ed-439b-8554-afbce02cf535 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:01.834205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4d85c-52ed-439b-8554-afbce02cf535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:01.842827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4d85c-52ed-439b-8554-afbce02cf535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:01.844275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac4d85c-52ed-439b-8554-afbce02cf535 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:01.853850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 728/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:22.538823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161cbca-8d59-483f-835b-8014aac14055 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:22.539414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161cbca-8d59-483f-835b-8014aac14055 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:22.539414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161cbca-8d59-483f-835b-8014aac14055 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:22.541194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 743/1471] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:22.546325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508acdc2-1f78-4e09-bb5d-6d7d9b1d645e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:22.546737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508acdc2-1f78-4e09-bb5d-6d7d9b1d645e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:22.546893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508acdc2-1f78-4e09-bb5d-6d7d9b1d645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:22.565633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-508acdc2-1f78-4e09-bb5d-6d7d9b1d645e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:22.566818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-508acdc2-1f78-4e09-bb5d-6d7d9b1d645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:22.575551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 729/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:22.621205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97b1a-8822-4d35-954a-ccd36034f0e7 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:22.621502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97b1a-8822-4d35-954a-ccd36034f0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:22.621785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b97b1a-8822-4d35-954a-ccd36034f0e7 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:22.623563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 744/1473] 10.222.0.23 () {54 vars in 961 bytes} [Tue Mar 29 15:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:22.628201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e19b2-65e2-4261-87cc-e5b5d26e7e0b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:22.628491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e19b2-65e2-4261-87cc-e5b5d26e7e0b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:22.628764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e19b2-65e2-4261-87cc-e5b5d26e7e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:22.647253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-520e19b2-65e2-4261-87cc-e5b5d26e7e0b None None] MFA Rules not processed for user `6b029906da704309ad9b8da03b51c054`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:22.648450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-520e19b2-65e2-4261-87cc-e5b5d26e7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:22.654663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 730/1474] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Mar 29 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:22.662252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b97b1a-8822-4d35-954a-ccd36034f0e7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:22.672488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b97b1a-8822-4d35-954a-ccd36034f0e7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:22.676003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23e8cf-4171-4cb5-bb4a-be20d4d8507f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:22.676561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e8cf-4171-4cb5-bb4a-be20d4d8507f service glance] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:22.676873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e8cf-4171-4cb5-bb4a-be20d4d8507f service glance] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:22.677154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e8cf-4171-4cb5-bb4a-be20d4d8507f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:22.685742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23e8cf-4171-4cb5-bb4a-be20d4d8507f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:22.687167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23e8cf-4171-4cb5-bb4a-be20d4d8507f service glance] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:22.697155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 745/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:25.089678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199b7a-56a7-4638-9d44-58d0a42a10ec None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:25.090201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199b7a-56a7-4638-9d44-58d0a42a10ec None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:25.090201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199b7a-56a7-4638-9d44-58d0a42a10ec None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:25.091942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 731/1476] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:25.097315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae232-14a3-49fe-bdab-f1fc1fd935f8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:25.097780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae232-14a3-49fe-bdab-f1fc1fd935f8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:25.097878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae232-14a3-49fe-bdab-f1fc1fd935f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:25.115989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c16ae232-14a3-49fe-bdab-f1fc1fd935f8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:25.117179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c16ae232-14a3-49fe-bdab-f1fc1fd935f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:25.124776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 746/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:25.148566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c199b7a-56a7-4638-9d44-58d0a42a10ec None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:25.160626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c199b7a-56a7-4638-9d44-58d0a42a10ec None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:25.164944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:25.165574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:25.165857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:25.166132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:25.166884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:25.168616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:52:25.168616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:52:25.168616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:52:25.169738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763089b-d193-4041-b669-a45d360b0697 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:25.188950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 732/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Mar 29 15:52:25 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:52:27.478073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e3c9-39d6-4106-8232-4f62cc56d259 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:27.478642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e3c9-39d6-4106-8232-4f62cc56d259 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:27.478642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7e3c9-39d6-4106-8232-4f62cc56d259 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:27.480455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 747/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:27.485749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5b94-2e38-429b-94d3-6b01a286ce96 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:27.486156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5b94-2e38-429b-94d3-6b01a286ce96 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:27.486313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a5b94-2e38-429b-94d3-6b01a286ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:27.505407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-264a5b94-2e38-429b-94d3-6b01a286ce96 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:27.506600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-264a5b94-2e38-429b-94d3-6b01a286ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:27.514368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 733/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:27.555847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7e3c9-39d6-4106-8232-4f62cc56d259 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:27.570182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7e3c9-39d6-4106-8232-4f62cc56d259 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:27.575513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb658a-c2bc-4b8e-b837-3adb7e54e976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:27.576168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb658a-c2bc-4b8e-b837-3adb7e54e976 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:27.576456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb658a-c2bc-4b8e-b837-3adb7e54e976 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:27.576737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb658a-c2bc-4b8e-b837-3adb7e54e976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:27.585166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb658a-c2bc-4b8e-b837-3adb7e54e976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:27.586754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb658a-c2bc-4b8e-b837-3adb7e54e976 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:27.595869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 748/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:30.031592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84120b-bfaf-4a03-8050-41bec2c001d7 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:30.032114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84120b-bfaf-4a03-8050-41bec2c001d7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:30.032114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84120b-bfaf-4a03-8050-41bec2c001d7 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:30.033811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 734/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:30.038932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c87b17-88a0-4777-8abd-e94a11cb527b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:30.039323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c87b17-88a0-4777-8abd-e94a11cb527b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:30.039599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c87b17-88a0-4777-8abd-e94a11cb527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:30.058251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-61c87b17-88a0-4777-8abd-e94a11cb527b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:30.059462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-61c87b17-88a0-4777-8abd-e94a11cb527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:30.067824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 749/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:30.104082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84120b-bfaf-4a03-8050-41bec2c001d7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:30.115936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84120b-bfaf-4a03-8050-41bec2c001d7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:30.120341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f796a6-30c7-428a-bc9b-f37c75ebd475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:30.121006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f796a6-30c7-428a-bc9b-f37c75ebd475 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:30.121289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f796a6-30c7-428a-bc9b-f37c75ebd475 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:30.121567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f796a6-30c7-428a-bc9b-f37c75ebd475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:30.130584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f796a6-30c7-428a-bc9b-f37c75ebd475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:30.132041 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f796a6-30c7-428a-bc9b-f37c75ebd475 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:30.141049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 735/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:32.439119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f173-3200-4a38-9d9b-0ac6504e90ed None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:32.439578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f173-3200-4a38-9d9b-0ac6504e90ed None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:32.439747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5f173-3200-4a38-9d9b-0ac6504e90ed None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:32.441529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 750/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:32.447557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aa715-edc6-4b0c-b68a-4c081b1916b7 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:32.447981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aa715-edc6-4b0c-b68a-4c081b1916b7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:32.448109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588aa715-edc6-4b0c-b68a-4c081b1916b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:32.471727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-588aa715-edc6-4b0c-b68a-4c081b1916b7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:32.472912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-588aa715-edc6-4b0c-b68a-4c081b1916b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:32.481186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 736/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:32.519340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5f173-3200-4a38-9d9b-0ac6504e90ed None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:32.530267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5f173-3200-4a38-9d9b-0ac6504e90ed None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:32.533707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96352d5-b953-4174-8e56-0491249608ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:32.534329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96352d5-b953-4174-8e56-0491249608ce service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:32.534611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96352d5-b953-4174-8e56-0491249608ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:32.534888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96352d5-b953-4174-8e56-0491249608ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:32.544264 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96352d5-b953-4174-8e56-0491249608ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:32.545684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96352d5-b953-4174-8e56-0491249608ce service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:32.555280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 751/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:34.934035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092af79f-90a5-45a4-bde0-fb07bfb9e2e4 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:34.934587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092af79f-90a5-45a4-bde0-fb07bfb9e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:34.934587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092af79f-90a5-45a4-bde0-fb07bfb9e2e4 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:34.936381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 737/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:34.941480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177b354-9f8b-42ad-8272-6370111a92cb None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:34.942367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177b354-9f8b-42ad-8272-6370111a92cb None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:34.942539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177b354-9f8b-42ad-8272-6370111a92cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:34.961754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b177b354-9f8b-42ad-8272-6370111a92cb None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:34.962940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b177b354-9f8b-42ad-8272-6370111a92cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:34.971079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 752/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:35.010888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092af79f-90a5-45a4-bde0-fb07bfb9e2e4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:35.021438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092af79f-90a5-45a4-bde0-fb07bfb9e2e4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:35.024872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff151c65-5796-4aa8-b079-d3dcfb5f49b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:35.025497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff151c65-5796-4aa8-b079-d3dcfb5f49b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:35.025783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff151c65-5796-4aa8-b079-d3dcfb5f49b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:35.026066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff151c65-5796-4aa8-b079-d3dcfb5f49b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:35.035043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff151c65-5796-4aa8-b079-d3dcfb5f49b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:35.036999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff151c65-5796-4aa8-b079-d3dcfb5f49b7 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:35.046109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 738/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:52:37.532325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab14dda-445a-45d0-8f97-bd1d91cb7fb0 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:37.532869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab14dda-445a-45d0-8f97-bd1d91cb7fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:37.532869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab14dda-445a-45d0-8f97-bd1d91cb7fb0 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:37.534713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 753/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue Mar 29 15:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:52:37.540362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d7f07-7843-46ee-8f82-795c693d5d3b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:37.540783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d7f07-7843-46ee-8f82-795c693d5d3b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:37.540919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d7f07-7843-46ee-8f82-795c693d5d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:37.558292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-5d8d7f07-7843-46ee-8f82-795c693d5d3b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:52:37.559472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5d8d7f07-7843-46ee-8f82-795c693d5d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:37.567130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 739/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Mar 29 15:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:52:37.608050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab14dda-445a-45d0-8f97-bd1d91cb7fb0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:52:37.609825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7ab14dda-445a-45d0-8f97-bd1d91cb7fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:52:37.623032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab14dda-445a-45d0-8f97-bd1d91cb7fb0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:52:37.626566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6306d-1bf0-46ed-8da3-9a42e20e4eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:52:37.627191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6306d-1bf0-46ed-8da3-9a42e20e4eae service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:52:37.627471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6306d-1bf0-46ed-8da3-9a42e20e4eae service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:52:37.627784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6306d-1bf0-46ed-8da3-9a42e20e4eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:52:37.637009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6306d-1bf0-46ed-8da3-9a42e20e4eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:52:37.638431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6306d-1bf0-46ed-8da3-9a42e20e4eae service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:52:37.648154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 754/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:54:03.671208 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.671831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.671831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.689462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:54:03.690951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:54:03.698715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 740/1494] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:54:03.708384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.708877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.708980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.726704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:54:03.727902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:54:03.735463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 755/1495] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:54:03.739991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:03.749599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be7bc9-cbfc-48d9-98db-598a7c274b75 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:03.754096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:03.754769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.755057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.755346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.756110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:54:03.756419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:03.757437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:03.757437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:54:03.757437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:54:03.758369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:03.771451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 741/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:54:03.780073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:03.788895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7ab88-5c96-4cbc-a20f-e418e1341fe3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:03.793363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:03.794009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.794288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.794582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.795270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:03.797018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:03.797018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:54:03.797018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:54:03.798196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:03.831952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 756/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:54:03 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:54:03.835994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:03.846202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd33a-d230-4e59-9d69-778487a1473f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:03.897835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:03.898491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.898777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.899057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.899790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:03.900802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:03.900802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:54:03.900802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:54:03.902002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:03.922193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 742/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:54:03 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:54:03.926654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:03.937037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0c90-efdb-46de-973c-489c7334150c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:03.941892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:03.942488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.942775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.943054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.943813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:03.944842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:03.944842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:54:03.944842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:54:03.945716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:03.958336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 757/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:54:03.962509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:03.973248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5a144-dfe5-4a41-aeae-305146c84088 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:03.977919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:03.978611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:03.978915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:03.979216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:03.979973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:03.981022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:03.981022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:54:03.981022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:54:03.981899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407e2b-0591-4934-8695-79d91125784a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:03.997961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 743/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:54:04.002235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:04.016295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39bb97-1ae4-4a94-8085-f791c28d7d46 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:04.024754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:04.025626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.025914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.026194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] PATH_INFO: `/v3/projects/0787001bc184442ea175c875b311b948/users/42685f6325e24a0a899e144ee7327c1c/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.048651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0787001bc184442ea175c875b311b948, user_id=42685f6325e24a0a899e144ee7327c1c, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:04.049699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:04.049699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:54:04.049699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:54:04.051655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:04.064352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 758/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:54:04 2022] PUT /identity/v3/projects/0787001bc184442ea175c875b311b948/users/42685f6325e24a0a899e144ee7327c1c/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:54:04.075770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40248c-9747-48ed-9abe-159148da2ede None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.076064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40248c-9747-48ed-9abe-159148da2ede None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.076342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40248c-9747-48ed-9abe-159148da2ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.103620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-4b40248c-9747-48ed-9abe-159148da2ede None None] MFA Rules not processed for user `42685f6325e24a0a899e144ee7327c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:54:04.104861 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4b40248c-9747-48ed-9abe-159148da2ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:54:04.166860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 744/1502] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:54:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:54:04.178371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:04.254180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3ce8d-56cf-4c32-8691-203d3faad49a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:04.259555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:04.260203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.260490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.260769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.271811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:04.273407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:04.282704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 759/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:54:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:54:04.360321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80f04-2c61-4aa8-84fd-dfd14fcbf62c None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.360611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80f04-2c61-4aa8-84fd-dfd14fcbf62c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.360888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b80f04-2c61-4aa8-84fd-dfd14fcbf62c None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.362619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 745/1504] 10.222.0.23 () {52 vars in 829 bytes} [Tue Mar 29 15:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:54:04.366432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:04.433985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956b9b5-5f69-408e-b203-58299cbd245e service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:04.441497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:04.441497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.441497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.441497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] PATH_INFO: `/v3/users/42685f6325e24a0a899e144ee7327c1c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.442026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42685f6325e24a0a899e144ee7327c1c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:04.442437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:04.442437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:54:04.442437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:54:04.443757 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:04.506655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42685f6325e24a0a899e144ee7327c1c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:04.507318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42685f6325e24a0a899e144ee7327c1c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:04.526045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42685f6325e24a0a899e144ee7327c1c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:04.537364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42685f6325e24a0a899e144ee7327c1c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:04.538640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42685f6325e24a0a899e144ee7327c1c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:04.556806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 760/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:54:04 2022] DELETE /identity/v3/users/42685f6325e24a0a899e144ee7327c1c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:54:04.562216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.562506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.562784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.580629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:54:04.581820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:54:04.640194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 746/1506] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:54:04.649727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:04.651168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:54:04.716174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e143f-7504-4104-b7d8-50f8b9d82795 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:04.720814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f9b80-78a7-4cef-aaed-968a8c5dacd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:04.721462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9b80-78a7-4cef-aaed-968a8c5dacd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:04.721751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9b80-78a7-4cef-aaed-968a8c5dacd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:04.722035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9b80-78a7-4cef-aaed-968a8c5dacd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:04.730848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f9b80-78a7-4cef-aaed-968a8c5dacd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:04.732359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f9b80-78a7-4cef-aaed-968a8c5dacd5 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:04.741807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 761/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:54:05.111471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:54:05.113009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:54:05.125336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42242e-32a1-43b1-9116-f1e7bb5e4cf3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:54:05.130149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:54:05.131089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:54:05.131380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:54:05.131701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] PATH_INFO: `/v3/projects/0787001bc184442ea175c875b311b948` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:54:05.133084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0787001bc184442ea175c875b311b948)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:54:05.134109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:54:05.134109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:54:05.134109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:54:05.135292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:54:05.194448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0787001bc184442ea175c875b311b948', 'request_id': 'req-509125c7-a2e8-49e7-95ce-d93260715ea5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:05.204229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0787001bc184442ea175c875b311b948', 'request_id': 'req-509125c7-a2e8-49e7-95ce-d93260715ea5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:05.210063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0787001bc184442ea175c875b311b948', 'request_id': 'req-509125c7-a2e8-49e7-95ce-d93260715ea5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:05.227766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] The token cache is being invalidate because project 0787001bc184442ea175c875b311b948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:54:05.228048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:05.228677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-509125c7-a2e8-49e7-95ce-d93260715ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:54:05.230287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 747/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:54:05 2022] DELETE /identity/v3/projects/0787001bc184442ea175c875b311b948 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:55:39.803099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074e56a-f419-407e-b894-dc377b8cd11b None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:39.804342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074e56a-f419-407e-b894-dc377b8cd11b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:39.804342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074e56a-f419-407e-b894-dc377b8cd11b None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:39.806070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 762/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 29 15:55:39.811031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35877-e52e-4a3a-bc98-aa091d423cfd None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:39.811464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35877-e52e-4a3a-bc98-aa091d423cfd None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:39.811618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff35877-e52e-4a3a-bc98-aa091d423cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:39.829301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0ff35877-e52e-4a3a-bc98-aa091d423cfd None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:39.830493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0ff35877-e52e-4a3a-bc98-aa091d423cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:39.890375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 748/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:55:40.043857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074e56a-f419-407e-b894-dc377b8cd11b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:55:40.045523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5074e56a-f419-407e-b894-dc377b8cd11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:40.119855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074e56a-f419-407e-b894-dc377b8cd11b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:55:40.125839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8551e00-0301-4d82-91f6-c78270c33854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:55:40.126699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551e00-0301-4d82-91f6-c78270c33854 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:40.127196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551e00-0301-4d82-91f6-c78270c33854 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:40.127718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551e00-0301-4d82-91f6-c78270c33854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:40.136442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8551e00-0301-4d82-91f6-c78270c33854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:55:40.138018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8551e00-0301-4d82-91f6-c78270c33854 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:55:40.146960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 763/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:55:40.693343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bac2d-a604-4348-bf8f-fcfe1b0b5da2 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:40.693639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bac2d-a604-4348-bf8f-fcfe1b0b5da2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:40.693944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bac2d-a604-4348-bf8f-fcfe1b0b5da2 None None] PATH_INFO: `/v3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:40.695261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 749/1512] 10.222.0.55 () {54 vars in 925 bytes} [Tue Mar 29 15:55:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:55:40.702272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a96b-0f8e-4902-ab70-6863d65e86aa None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:40.702560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a96b-0f8e-4902-ab70-6863d65e86aa None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:40.703248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a96b-0f8e-4902-ab70-6863d65e86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:40.722937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ee74a96b-0f8e-4902-ab70-6863d65e86aa None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:40.724229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ee74a96b-0f8e-4902-ab70-6863d65e86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:40.795461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 764/1513] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Mar 29 15:55:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:55:41.427930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0cdbb-7823-4cb4-90d9-6a16d3dcf3d2 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:41.429004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0cdbb-7823-4cb4-90d9-6a16d3dcf3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:41.429004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0cdbb-7823-4cb4-90d9-6a16d3dcf3d2 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:41.430781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:55:41.435736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bc6a7-e4ec-45af-9c6b-42cc0aef35d8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:41.436184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bc6a7-e4ec-45af-9c6b-42cc0aef35d8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:41.436290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bc6a7-e4ec-45af-9c6b-42cc0aef35d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:41.454593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d49bc6a7-e4ec-45af-9c6b-42cc0aef35d8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:41.455807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d49bc6a7-e4ec-45af-9c6b-42cc0aef35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:41.463919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:55:41.615349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0cdbb-7823-4cb4-90d9-6a16d3dcf3d2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:55:41.630516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0cdbb-7823-4cb4-90d9-6a16d3dcf3d2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:55:41.636452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a4462-8127-4381-b58e-afd957b15ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:55:41.637078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4462-8127-4381-b58e-afd957b15ec0 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:41.637364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4462-8127-4381-b58e-afd957b15ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:41.637643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a4462-8127-4381-b58e-afd957b15ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:41.645506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4462-8127-4381-b58e-afd957b15ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:55:41.647082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a4462-8127-4381-b58e-afd957b15ec0 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:55:41.656284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 751/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:55:44.739973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca76e6f-c38b-4f43-b98d-4d2966d0f7b9 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:44.740548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca76e6f-c38b-4f43-b98d-4d2966d0f7b9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:44.740548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca76e6f-c38b-4f43-b98d-4d2966d0f7b9 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:44.742357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 766/1517] 10.222.0.23 () {54 vars in 960 bytes} [Tue Mar 29 15:55:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:55:44.747581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afd413-12bc-4cf3-9e3d-abb1aa4bf6e1 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:44.748013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afd413-12bc-4cf3-9e3d-abb1aa4bf6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:44.748252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afd413-12bc-4cf3-9e3d-abb1aa4bf6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:44.766486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-26afd413-12bc-4cf3-9e3d-abb1aa4bf6e1 None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:44.767806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-26afd413-12bc-4cf3-9e3d-abb1aa4bf6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:44.777170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 752/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Mar 29 15:55:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:55:44.784761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca76e6f-c38b-4f43-b98d-4d2966d0f7b9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:55:44.798190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca76e6f-c38b-4f43-b98d-4d2966d0f7b9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:55:44.803023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b44d4-9319-4b54-8a05-4bc459c69e40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:55:44.803687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b44d4-9319-4b54-8a05-4bc459c69e40 service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:44.803968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b44d4-9319-4b54-8a05-4bc459c69e40 service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:44.804241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b44d4-9319-4b54-8a05-4bc459c69e40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:44.812503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b44d4-9319-4b54-8a05-4bc459c69e40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:55:44.814075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b44d4-9319-4b54-8a05-4bc459c69e40 service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:55:44.823851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 767/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:55:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:55:53.358646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256a95-7bf0-416b-b698-60e23ed686d2 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:53.359240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256a95-7bf0-416b-b698-60e23ed686d2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:53.359240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b256a95-7bf0-416b-b698-60e23ed686d2 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:53.360990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 753/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:55:53.365820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6266a7-733c-4604-bb61-9eea24d84014 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:53.366239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6266a7-733c-4604-bb61-9eea24d84014 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:53.366375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6266a7-733c-4604-bb61-9eea24d84014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:53.384238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ff6266a7-733c-4604-bb61-9eea24d84014 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:53.385411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ff6266a7-733c-4604-bb61-9eea24d84014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:53.393082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 768/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:55:53.544365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b256a95-7bf0-416b-b698-60e23ed686d2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:55:53.559431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b256a95-7bf0-416b-b698-60e23ed686d2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:55:53.565151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06a2cb-dcdb-49b5-8694-dd5eb1d9f407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:55:53.565786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06a2cb-dcdb-49b5-8694-dd5eb1d9f407 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:53.566067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06a2cb-dcdb-49b5-8694-dd5eb1d9f407 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:53.566343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06a2cb-dcdb-49b5-8694-dd5eb1d9f407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:53.574871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06a2cb-dcdb-49b5-8694-dd5eb1d9f407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:55:53.576472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06a2cb-dcdb-49b5-8694-dd5eb1d9f407 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:55:53.585662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 754/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:55:54.850289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224e47-08b4-470c-9ba5-0dc01aa83483 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:54.850812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224e47-08b4-470c-9ba5-0dc01aa83483 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:54.850812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1224e47-08b4-470c-9ba5-0dc01aa83483 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:54.852550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 769/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 29 15:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:55:54.857341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67725f-d8c4-41b5-802c-b31fc5ac6cf9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:54.857736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67725f-d8c4-41b5-802c-b31fc5ac6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:54.857913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67725f-d8c4-41b5-802c-b31fc5ac6cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:54.875446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fa67725f-d8c4-41b5-802c-b31fc5ac6cf9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:54.876665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa67725f-d8c4-41b5-802c-b31fc5ac6cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:54.884829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 755/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 29 15:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:55:55.033995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224e47-08b4-470c-9ba5-0dc01aa83483 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:55:55.050445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1224e47-08b4-470c-9ba5-0dc01aa83483 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:55:55.059288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1679a43-51c3-4f2e-a2db-300d628fb6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:55:55.059990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1679a43-51c3-4f2e-a2db-300d628fb6c4 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:55.060278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1679a43-51c3-4f2e-a2db-300d628fb6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:55.060554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1679a43-51c3-4f2e-a2db-300d628fb6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:55.069602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1679a43-51c3-4f2e-a2db-300d628fb6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:55:55.071183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1679a43-51c3-4f2e-a2db-300d628fb6c4 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:55:55.080289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 770/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:55:59.953042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc9c2e-2d89-4650-8f2b-6aa53b1c036d None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:59.953604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc9c2e-2d89-4650-8f2b-6aa53b1c036d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:59.953825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc9c2e-2d89-4650-8f2b-6aa53b1c036d None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:59.956421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 756/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:55:59.961680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131d59-b2c1-44c8-ba0c-7576d1a07a49 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:55:59.962134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131d59-b2c1-44c8-ba0c-7576d1a07a49 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:55:59.962252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131d59-b2c1-44c8-ba0c-7576d1a07a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:55:59.984600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b0131d59-b2c1-44c8-ba0c-7576d1a07a49 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:55:59.986551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b0131d59-b2c1-44c8-ba0c-7576d1a07a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:55:59.997267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 771/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:56:00.036084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc9c2e-2d89-4650-8f2b-6aa53b1c036d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:56:00.038314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ddcc9c2e-2d89-4650-8f2b-6aa53b1c036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:56:00.093919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc9c2e-2d89-4650-8f2b-6aa53b1c036d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:56:00.097503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c46dac-3e4b-43dc-85c2-151027a1de5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:56:00.098146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c46dac-3e4b-43dc-85c2-151027a1de5e service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:00.098431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c46dac-3e4b-43dc-85c2-151027a1de5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:00.098707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c46dac-3e4b-43dc-85c2-151027a1de5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:00.107924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c46dac-3e4b-43dc-85c2-151027a1de5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:56:00.109359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c46dac-3e4b-43dc-85c2-151027a1de5e service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:56:00.119064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 757/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:56:02.426671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8c26-5345-443a-a2c1-4b1f074a131e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:02.427239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8c26-5345-443a-a2c1-4b1f074a131e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:02.427346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8c26-5345-443a-a2c1-4b1f074a131e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:02.429698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 772/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:56:02.435033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa885-93d6-4e98-9517-bffc54d7decf None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:02.435499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa885-93d6-4e98-9517-bffc54d7decf None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:02.435630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fa885-93d6-4e98-9517-bffc54d7decf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:02.453527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c35fa885-93d6-4e98-9517-bffc54d7decf None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:56:02.454708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c35fa885-93d6-4e98-9517-bffc54d7decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:56:02.463005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 758/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:56:02.498281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8c26-5345-443a-a2c1-4b1f074a131e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:56:02.508721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8c26-5345-443a-a2c1-4b1f074a131e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:56:02.512190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141bea5-63ec-49aa-af2e-761f946a7bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:56:02.512811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141bea5-63ec-49aa-af2e-761f946a7bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:02.513093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141bea5-63ec-49aa-af2e-761f946a7bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:02.513370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141bea5-63ec-49aa-af2e-761f946a7bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:02.522427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141bea5-63ec-49aa-af2e-761f946a7bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:56:02.523878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141bea5-63ec-49aa-af2e-761f946a7bb5 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:56:02.533049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 773/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:56:06.439836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3b929-32ba-439a-a350-5c2a3b4f8b6f None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:06.440404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3b929-32ba-439a-a350-5c2a3b4f8b6f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:06.440515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3b929-32ba-439a-a350-5c2a3b4f8b6f None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:06.442237 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 759/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:56:06.447363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b738-670e-4df2-8ffe-aeb173a10400 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:06.447842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b738-670e-4df2-8ffe-aeb173a10400 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:06.447947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061b738-670e-4df2-8ffe-aeb173a10400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:06.465787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7061b738-670e-4df2-8ffe-aeb173a10400 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:56:06.466955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7061b738-670e-4df2-8ffe-aeb173a10400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:56:06.475036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 774/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:56:06.725837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3b929-32ba-439a-a350-5c2a3b4f8b6f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:56:06.727497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-edf3b929-32ba-439a-a350-5c2a3b4f8b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:56:06.784489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3b929-32ba-439a-a350-5c2a3b4f8b6f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:56:06.788487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c7640-8e19-4d03-a848-3ede9705f26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:56:06.789138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7640-8e19-4d03-a848-3ede9705f26d service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:06.789418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7640-8e19-4d03-a848-3ede9705f26d service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:06.789726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c7640-8e19-4d03-a848-3ede9705f26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:06.798294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7640-8e19-4d03-a848-3ede9705f26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:56:06.799751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c7640-8e19-4d03-a848-3ede9705f26d service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:56:06.809449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 760/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:56:09.151473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d516-3039-4a19-932d-e4360dd8d297 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:09.152100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d516-3039-4a19-932d-e4360dd8d297 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:09.152100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d516-3039-4a19-932d-e4360dd8d297 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:09.153839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 775/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 29 15:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:56:09.159063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4305e-649f-47ef-8797-1d7dc4866f8d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:09.159513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4305e-649f-47ef-8797-1d7dc4866f8d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:09.159661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4305e-649f-47ef-8797-1d7dc4866f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:09.179742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a0e4305e-649f-47ef-8797-1d7dc4866f8d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:56:09.180905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a0e4305e-649f-47ef-8797-1d7dc4866f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:56:09.188709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 761/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 29 15:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:56:09.444110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db135c-b65f-4bc5-b528-4982642307cc None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:09.444404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db135c-b65f-4bc5-b528-4982642307cc None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:09.444689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db135c-b65f-4bc5-b528-4982642307cc None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:09.446448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 776/1537] 10.222.0.23 () {54 vars in 962 bytes} [Tue Mar 29 15:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:56:09.451331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc336-bc72-407f-9ea8-2cdd9c717550 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:09.451659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc336-bc72-407f-9ea8-2cdd9c717550 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:09.451938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc336-bc72-407f-9ea8-2cdd9c717550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:09.469545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8a9dc336-bc72-407f-9ea8-2cdd9c717550 None None] MFA Rules not processed for user `f956c2a9dfbd40fbabd043c371e579e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:56:09.470710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8a9dc336-bc72-407f-9ea8-2cdd9c717550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:56:09.476992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 762/1538] 10.222.0.23 () {58 vars in 1059 bytes} [Tue Mar 29 15:56:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:56:09.486296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db135c-b65f-4bc5-b528-4982642307cc None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:56:09.497296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db135c-b65f-4bc5-b528-4982642307cc None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:56:09.500795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e863-a51c-471a-b4d2-9a554657f56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:56:09.501415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e863-a51c-471a-b4d2-9a554657f56d service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:56:09.501699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e863-a51c-471a-b4d2-9a554657f56d service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:56:09.501973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e863-a51c-471a-b4d2-9a554657f56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:56:09.511680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555e863-a51c-471a-b4d2-9a554657f56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:56:09.513098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555e863-a51c-471a-b4d2-9a554657f56d service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:56:09.522845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 777/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:36.522509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.523767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.524325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.550398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.552234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.565820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 763/1540] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.577646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb77d-bcae-438a-9fcc-a5d60084a43a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.578232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb77d-bcae-438a-9fcc-a5d60084a43a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.578232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccb77d-bcae-438a-9fcc-a5d60084a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.602577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-36ccb77d-bcae-438a-9fcc-a5d60084a43a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.604178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-36ccb77d-bcae-438a-9fcc-a5d60084a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.618366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 778/1541] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.623785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:36.636775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aef6b0-ca60-4ee1-98fb-b787c39a373e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:36.648558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d22f-6750-4edb-b0b1-fe4a40f5653a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.648786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:36.649252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.649516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d22f-6750-4edb-b0b1-fe4a40f5653a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.649634 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.649782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.650237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d22f-6750-4edb-b0b1-fe4a40f5653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.650525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:36.650836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:36.652497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:36.678124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 764/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:36.679447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6c50d22f-6750-4edb-b0b1-fe4a40f5653a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.681447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:36.682326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6c50d22f-6750-4edb-b0b1-fe4a40f5653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.696500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e7aa0-e978-4328-9e84-4d19e2de8035 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:36.704450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 779/1543] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:57:36.705860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.706144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.707156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.712328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:36.713016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.713300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.713576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.714450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:36.715746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:57:36.715746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:57:36.715746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:57:36.717497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7a0cd-7e98-4d74-9632-ebd0c9f4e0c5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:36.757285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.765966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.794626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 765/1544] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:57:36.795684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 780/1545] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.800290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cd4cb-e793-48f1-8049-0dd6b710d2c8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.800664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cd4cb-e793-48f1-8049-0dd6b710d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.801015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cd4cb-e793-48f1-8049-0dd6b710d2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.811836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:36.826259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4801c-2725-44bf-8add-b7de73d11eae None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:36.842707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-823cd4cb-e793-48f1-8049-0dd6b710d2c8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.843937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-823cd4cb-e793-48f1-8049-0dd6b710d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.913770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:36.914445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.914726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.915011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.918754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:36.918754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:57:36.918754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:57:36.918754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:57:36.918754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c40f8f-f33e-4887-a361-632e660eac8e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:36.931751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 766/1546] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.933461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85e423-c128-4d52-b7d6-76288b5c848a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.933750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85e423-c128-4d52-b7d6-76288b5c848a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.934031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85e423-c128-4d52-b7d6-76288b5c848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.939572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 781/1547] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:36.940492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d5a3-ce49-4fcb-961a-cfce2423f84e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.940776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d5a3-ce49-4fcb-961a-cfce2423f84e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.941915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d5a3-ce49-4fcb-961a-cfce2423f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.952569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1b85e423-c128-4d52-b7d6-76288b5c848a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.953751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1b85e423-c128-4d52-b7d6-76288b5c848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.958357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f1a1d5a3-ce49-4fcb-961a-cfce2423f84e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.959499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f1a1d5a3-ce49-4fcb-961a-cfce2423f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.961450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 767/1548] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.962629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dc92a-4406-4f4d-b409-5a90e8dce8a9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.962918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dc92a-4406-4f4d-b409-5a90e8dce8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.963194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dc92a-4406-4f4d-b409-5a90e8dce8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.969270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 782/1549] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.970648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff55f0e-0aa1-4ee3-9300-b37ef00b7044 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.970949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff55f0e-0aa1-4ee3-9300-b37ef00b7044 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.971231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff55f0e-0aa1-4ee3-9300-b37ef00b7044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:36.983120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-525dc92a-4406-4f4d-b409-5a90e8dce8a9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.984340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-525dc92a-4406-4f4d-b409-5a90e8dce8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.988810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-eff55f0e-0aa1-4ee3-9300-b37ef00b7044 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:36.989998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-eff55f0e-0aa1-4ee3-9300-b37ef00b7044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:36.992199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 768/1550] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:36.993558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:36.993684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:36.994035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.002734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 783/1551] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.004101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.004392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.004672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.019516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.020759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.023166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.024394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.028642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 769/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.030035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.033352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 784/1553] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.036375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.042342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564218e-b643-4c3d-b4e8-6fca3571bf79 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.046767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e677-938d-4ca6-b426-e12a8ff41f98 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.046958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.047664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.047969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.048240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.048988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.049292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.050904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.051228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdef61-a2c6-4003-a683-6d15a3b514cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.051981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdef61-a2c6-4003-a683-6d15a3b514cf admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.052262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdef61-a2c6-4003-a683-6d15a3b514cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.052536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdef61-a2c6-4003-a683-6d15a3b514cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.053255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdef61-a2c6-4003-a683-6d15a3b514cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.054837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdef61-a2c6-4003-a683-6d15a3b514cf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.062786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 770/1554] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.064414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.067577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 785/1555] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:37.067577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab53b7-665b-43d8-b5a6-69c40b876ba9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.067577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab53b7-665b-43d8-b5a6-69c40b876ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.067577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab53b7-665b-43d8-b5a6-69c40b876ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.074448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc69f04-f4a6-44c5-80ce-615c3ce33230 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.079577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.080228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.080608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.080782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.081649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.081951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.083580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961420c-a732-40ce-9703-8ac0484ba45b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.084584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-bfab53b7-665b-43d8-b5a6-69c40b876ba9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.085763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bfab53b7-665b-43d8-b5a6-69c40b876ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.093633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 786/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.094875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9879-7c03-4614-b707-273c9b89e82d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.095163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9879-7c03-4614-b707-273c9b89e82d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.095439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9879-7c03-4614-b707-273c9b89e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.099157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 771/1557] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.100301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b68f4-e2e8-4753-a6cc-dcfcffbaef58 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.100590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b68f4-e2e8-4753-a6cc-dcfcffbaef58 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.100864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b68f4-e2e8-4753-a6cc-dcfcffbaef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.116070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4e1c9879-7c03-4614-b707-273c9b89e82d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.117259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4e1c9879-7c03-4614-b707-273c9b89e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.118456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9a5b68f4-e2e8-4753-a6cc-dcfcffbaef58 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.119675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9a5b68f4-e2e8-4753-a6cc-dcfcffbaef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.124979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 787/1558] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.126999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca74465-6cde-49c2-8929-82352852d91e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.127294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca74465-6cde-49c2-8929-82352852d91e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.127480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 772/1559] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.127625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca74465-6cde-49c2-8929-82352852d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.130883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.130883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.130883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.147764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.148034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cca74465-6cde-49c2-8929-82352852d91e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.148918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.149169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cca74465-6cde-49c2-8929-82352852d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.157095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 773/1560] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.160727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 788/1561] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.160890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.161002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca74465-6cde-49c2-8929-82352852d91e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.168019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca74465-6cde-49c2-8929-82352852d91e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.169597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f4065-30b1-4486-8c26-a581b93b0dee None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.172643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.173352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.173638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.173914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.174308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.174628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.174931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.175213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.175489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.176196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.176302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.178075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.186213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 789/1562] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:37.187010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.196387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59ee7d-4c68-4e08-af37-13dd4a766581 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.200971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.202109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.202393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.202675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.203416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.203784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.204340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 774/1563] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.204804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:57:37.204804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:57:37.204804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:57:37.205198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.205668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.220749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 790/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.220749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.229616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c380-e5c7-466b-9033-3ccb7a68f343 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.266475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e3af9-637c-44d1-9568-a091361d4c7a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.270988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.271688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.271969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.272239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.272931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.274803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.283028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.283707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.284004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.284278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.284995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.285306 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.286896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.298912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 775/1565] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.299339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 791/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.300208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.304425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.310183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374f4fd-9e01-42b2-97c4-37f06033d330 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.362418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d57b-0a2c-4a2f-bd98-8a1157cef78f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.363444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.364131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.364416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.364694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.365487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.365971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.367911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.375040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.375780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.376068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.376348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.377070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.377371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.379110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.380081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 792/1567] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.381136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.391540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006469-847b-4820-b8fa-768f57b484ae admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.395996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.396628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.396915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.397192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.397935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:37.398245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.405865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 776/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.405865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.406139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.408894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd2f9b-5168-4158-ad3c-dd6d18a1279b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.411938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 793/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:37.412879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.413657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.414483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.414764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.415038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] PATH_INFO: `/v3/projects/1048ec44b09a4fceb22ea03497bac371/users/6ecde8d802f04ab7bde761e9a0e6b6d4/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.422260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e5bcf-deb1-4d8f-a12c-879ca3b87576 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.427024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.427704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.427989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.428265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.428936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.429652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1048ec44b09a4fceb22ea03497bac371, user_id=6ecde8d802f04ab7bde761e9a0e6b6d4, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.430671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:57:37.430671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:57:37.430671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:57:37.430941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.432872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.446659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 777/1570] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:37 2022] PUT /identity/v3/projects/1048ec44b09a4fceb22ea03497bac371/users/6ecde8d802f04ab7bde761e9a0e6b6d4/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:37.447420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.454368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 794/1571] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.454368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.461724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c978817-d852-4b6d-8ee8-679584343662 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.505674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c837b58f-3383-4026-9114-844a6600bae7 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.510294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.510957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.511241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.511565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.512257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.514205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.515507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.516227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.516509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.516781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.517455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.519349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.538465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 795/1572] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.539085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.542690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 778/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.542690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.548338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24e4ee-859d-4d95-bb8e-808a733e82d8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.602230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fef08-da5f-4277-bb9f-d105c99a15b7 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.604845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.605511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.605799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.607340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.607340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.607852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.608507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.608795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.608912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.609067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.609751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.611657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.639836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 796/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.640050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 779/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.640156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.640577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.697718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892bb5-e609-487e-9191-9ae3d4503963 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.698380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5888712-26ba-42ba-a129-bb338d5e242c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.702798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.703443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.703663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41bfb3-355e-4e26-89b8-08b6f2c49873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.703787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.704022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.704315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41bfb3-355e-4e26-89b8-08b6f2c49873 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.704603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41bfb3-355e-4e26-89b8-08b6f2c49873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.704712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.704885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41bfb3-355e-4e26-89b8-08b6f2c49873 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.705573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41bfb3-355e-4e26-89b8-08b6f2c49873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.706626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.707480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41bfb3-355e-4e26-89b8-08b6f2c49873 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.732075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 797/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.733854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.734144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.734423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.735602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 780/1576] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.736723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.752934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:37.754118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:37.796839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a936e7-cc12-4a3a-bbdf-360f43838550 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.812145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 798/1578] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:37.813071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.824894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669b96-f047-4a99-aaab-e6c7bba6fcf7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.830752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.831407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.831725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.832005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.832741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.834562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.847378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 799/1579] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:37.847378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.852174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.852911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.853143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.853425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.854152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.854502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aa1fa-4d5f-4b3e-ac3f-50d10c55f159 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.855951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.859299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.859964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.860252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.860535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.861213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.863103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.865605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 781/1580] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:37.866382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.875862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5c67a-58fb-4ff9-966c-643958ad26de admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.880487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.881126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.881413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.881694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.882368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.884749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 800/1581] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.884867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.885545 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.896031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd924773-f458-4ecc-ad0b-1a9199b6a9b1 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.903157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.903942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.904233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.905073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.905914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.908152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.911706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 782/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.912993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.922819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958659b4-89fd-4b57-aad0-d1a02cb53444 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.928113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.928771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.929052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.929327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.932967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 801/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.933120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.933222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.933320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.940253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e5eb9-03d9-4802-b681-a4433d9f47a0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.945885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.946679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.946967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.947253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.947978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.949893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:37.954870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 783/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.954870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.974623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 802/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:37 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:37.974623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:37.984440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0de4b-d9ec-4405-b43a-6b2448e488b5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:37.989020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:37.989657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:37.989946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:37.990221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:37.990934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:37.992576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.002639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 803/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.003649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.007069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca633d9-ec40-4c8b-acda-1d2a8fdeffc8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.011077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.011750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.012038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.012317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.012968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f25ce-dcf7-45db-a23e-17aa5c04400f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.017877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.018495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.018776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.019049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.019771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.021326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.021938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.023356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.031092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 804/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.031861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.035838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 784/1588] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:38.036710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.041422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3489d5-5060-4c19-a80e-756e4c56ab93 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.047025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39d1b-8c89-454f-bfe3-eacc967d6a8a service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.047621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.048399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.049062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.049062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.049920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.051549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.051996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.052643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.053038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.053176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.054125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.055616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.064075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 805/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.067928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.068685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 785/1590] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.069719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.079762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fe078-7540-484a-809f-a990674ea52e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.080425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f8200-e7a7-40bb-8465-eec27b255de8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.085077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.085215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.085792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.085908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.086077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.086305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.086479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.086710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.087205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.087581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.088990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.089299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.099866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 786/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.102866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 806/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.104947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.105070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.115161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df8552-b5a6-4b34-899c-0f0452681cf3 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.116527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d834-ae4d-45a4-85ce-f1409d96aec6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.120230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.121127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.121401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.121651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.121785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] PATH_INFO: `/v3/projects/6f18a03531a148439d234ae6b755c6e3/users/5fd0081eadf440078063c7a260f5bc6b/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.122310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.122810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.122925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.123646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.125705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.140470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 787/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.140470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.141260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f18a03531a148439d234ae6b755c6e3, user_id=5fd0081eadf440078063c7a260f5bc6b, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.144004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.148351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66785afd-a631-4803-86e4-7874c3e9c8f3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.155037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.155959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.156435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.156721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] PATH_INFO: `/v3/projects/7e1b85555d1347f99e15d588f33948bc/users/fc9110431b1c4a919cfe4ecd7d4016dd/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.159515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 807/1594] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/6f18a03531a148439d234ae6b755c6e3/users/5fd0081eadf440078063c7a260f5bc6b/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.170007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.182901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1b85555d1347f99e15d588f33948bc, user_id=fc9110431b1c4a919cfe4ecd7d4016dd, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.186271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.204713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 788/1595] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/7e1b85555d1347f99e15d588f33948bc/users/fc9110431b1c4a919cfe4ecd7d4016dd/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.208384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.238235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f5d5e-d1ba-4981-b3fa-98a95706a034 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.294979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eea62-9b8a-404a-8462-ec9a2751c38b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.297488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.298260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.298623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.298968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.299807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.300020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.300505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.300784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.301242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.301758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.302296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.303669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.319084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 808/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.319084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.319392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 789/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.319392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.329918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a8a39-d362-4400-ada9-f2882a4b7fa2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.330464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1182bf-e1e7-4f40-b9ba-9d4b56b35537 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.334762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.335238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dfc6a-e843-4c97-8c70-df4f9af7d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.335601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.335968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.336127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dfc6a-e843-4c97-8c70-df4f9af7d17c admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.336360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.336543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dfc6a-e843-4c97-8c70-df4f9af7d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.336989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dfc6a-e843-4c97-8c70-df4f9af7d17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.337256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.337858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dfc6a-e843-4c97-8c70-df4f9af7d17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.339010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.339619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795dfc6a-e843-4c97-8c70-df4f9af7d17c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.349928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 809/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.350735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.356352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 790/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.356352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.356352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.356352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.363852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51f3e-ae1e-40e7-9915-4f9149b536ab admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.368641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a678d1-6094-4427-b17e-4462291fcd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.369465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a678d1-6094-4427-b17e-4462291fcd3f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.370098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a678d1-6094-4427-b17e-4462291fcd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.370196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a678d1-6094-4427-b17e-4462291fcd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.371178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a678d1-6094-4427-b17e-4462291fcd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.373614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a678d1-6094-4427-b17e-4462291fcd3f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.388315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 810/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:38.388315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.388315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.388315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.390306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] MFA Rules not processed for user `5fd0081eadf440078063c7a260f5bc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:38.391747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:38.407738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:38.408991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:38.421570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 811/1601] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:38.422615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.433481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc912bb2-e199-483f-b3e5-c041e463d1c8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.439132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.440067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.440347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.440678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] PATH_INFO: `/v3/projects/f914e82002554d84bd9f3ae854c070ad/users/121a7604047f47bd8ce4f490f51348b0/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.458943 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f914e82002554d84bd9f3ae854c070ad, user_id=121a7604047f47bd8ce4f490f51348b0, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.461994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.483220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 812/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/f914e82002554d84bd9f3ae854c070ad/users/121a7604047f47bd8ce4f490f51348b0/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.483220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.502223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 791/1603] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:38.503131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.516128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425d77-a23e-4d8b-a108-32120f1901a1 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.552279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ef7d-f333-4079-a834-1cb3f31f4877 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.557390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.558273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.558556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.558827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] PATH_INFO: `/v3/projects/7a9dfb27d3cc4ce6b6e479c56067c104/users/52c866ddbec94cdb8268ef06ffd49654/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.574179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9dfb27d3cc4ce6b6e479c56067c104, user_id=52c866ddbec94cdb8268ef06ffd49654, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.575553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.577191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.577897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.577897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] PATH_INFO: `/v3/projects/a9ae60bd4d8b4687945728a86db9334a/users/e94093b0845649eabd9ef006b1313431/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.578165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.592409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 813/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/7a9dfb27d3cc4ce6b6e479c56067c104/users/52c866ddbec94cdb8268ef06ffd49654/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.597109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ae60bd4d8b4687945728a86db9334a, user_id=e94093b0845649eabd9ef006b1313431, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.599817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.602808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.614963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 792/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/a9ae60bd4d8b4687945728a86db9334a/users/e94093b0845649eabd9ef006b1313431/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.616332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.667751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf01b4-6b88-4e1d-9c8e-2f079b6398e5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.685851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d6ab-1678-45db-9422-ccbcf60bbfac admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.690907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.691828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.692100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.692378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] PATH_INFO: `/v3/projects/78017a13ef7b4d90a1ea6145bf2f5232/users/23a85c0f0bff4056af1d8f6691da236c/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.719478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78017a13ef7b4d90a1ea6145bf2f5232, user_id=23a85c0f0bff4056af1d8f6691da236c, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.722436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.726635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738ca94-7404-4f69-a6aa-fc9309f194a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.727776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738ca94-7404-4f69-a6aa-fc9309f194a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.727951 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738ca94-7404-4f69-a6aa-fc9309f194a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.728404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738ca94-7404-4f69-a6aa-fc9309f194a0 admin admin] PATH_INFO: `/v3/projects/49d2909e43fa4508af3151a299a86de4/users/c5667b1028f34b5d8da72bb300f5735a/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.738336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 793/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/78017a13ef7b4d90a1ea6145bf2f5232/users/23a85c0f0bff4056af1d8f6691da236c/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.739612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.746008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738ca94-7404-4f69-a6aa-fc9309f194a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d2909e43fa4508af3151a299a86de4, user_id=c5667b1028f34b5d8da72bb300f5735a, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.749003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738ca94-7404-4f69-a6aa-fc9309f194a0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.783447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 814/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:38 2022] PUT /identity/v3/projects/49d2909e43fa4508af3151a299a86de4/users/c5667b1028f34b5d8da72bb300f5735a/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:38.784996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.785286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.785565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.803114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4da60-28d8-488d-bfb4-f342249b9642 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.811858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:38.813609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:38.866097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3bb52-e934-47df-aa1f-0aacd01ad778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.866838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bb52-e934-47df-aa1f-0aacd01ad778 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.867177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bb52-e934-47df-aa1f-0aacd01ad778 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.867464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3bb52-e934-47df-aa1f-0aacd01ad778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.885753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 815/1608] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:38.886762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:38.957403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3bb52-e934-47df-aa1f-0aacd01ad778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:38.958961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3bb52-e934-47df-aa1f-0aacd01ad778 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:38.960173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e18c3f-c446-4490-865a-e61c31936408 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:38.964691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf9bfa-aa06-4671-a39e-7357ee205f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:38.965478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf9bfa-aa06-4671-a39e-7357ee205f50 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.965772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf9bfa-aa06-4671-a39e-7357ee205f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.966057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf9bfa-aa06-4671-a39e-7357ee205f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:38.971661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 794/1609] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:38.973126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e0a8-92a7-46a2-a6e7-4d4ae9c69c85 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:38.973480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e0a8-92a7-46a2-a6e7-4d4ae9c69c85 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:38.973829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e0a8-92a7-46a2-a6e7-4d4ae9c69c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.018217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f261e0a8-92a7-46a2-a6e7-4d4ae9c69c85 None None] MFA Rules not processed for user `52c866ddbec94cdb8268ef06ffd49654`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:39.019791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f261e0a8-92a7-46a2-a6e7-4d4ae9c69c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.052938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf9bfa-aa06-4671-a39e-7357ee205f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.054982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf9bfa-aa06-4671-a39e-7357ee205f50 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.074515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 816/1610] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:39.076215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.077078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.077523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.115279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] MFA Rules not processed for user `e94093b0845649eabd9ef006b1313431`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:39.119087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.142015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 795/1611] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:39.144512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7576-d4fa-4984-bbbd-9869fca5c8e8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.145028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7576-d4fa-4984-bbbd-9869fca5c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.145461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7576-d4fa-4984-bbbd-9869fca5c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.187094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-92cc7576-d4fa-4984-bbbd-9869fca5c8e8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:39.189687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-92cc7576-d4fa-4984-bbbd-9869fca5c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.205530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 796/1612] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:39.207242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.207649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.208024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.268733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 817/1613] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:39.269263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] MFA Rules not processed for user `c5667b1028f34b5d8da72bb300f5735a`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:39.270768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.270938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:39.276114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.303842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ca5c-bb03-4328-8464-9b9d4ce83f86 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:39.313699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:39.314655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.314776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.314980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.340915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.342490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.357913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 818/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:39.358880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:39.370043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07776d40-9f49-48d5-91fd-8228dfa8319b service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:39.379422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 797/1615] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:39.379658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:39.379658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.379855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:39.379944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.379944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.379944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.386345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298856-5e3b-4fc9-a294-a13a63c8b641 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:39.391612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.391881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b61e0-8271-44eb-b139-4be8d4fadf59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:39.393317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b61e0-8271-44eb-b139-4be8d4fadf59 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.393838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b61e0-8271-44eb-b139-4be8d4fadf59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.394215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b61e0-8271-44eb-b139-4be8d4fadf59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.406716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b61e0-8271-44eb-b139-4be8d4fadf59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.408664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b61e0-8271-44eb-b139-4be8d4fadf59 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.424150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 798/1616] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:39.425572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b56e-d0c3-4910-a918-f2223564623c None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.425952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b56e-d0c3-4910-a918-f2223564623c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.426506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769b56e-d0c3-4910-a918-f2223564623c None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.429184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 799/1617] 10.222.0.23 () {54 vars in 960 bytes} [Tue Mar 29 15:57:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:57:39.430857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abd5d2-3440-4399-bbd0-f62a684a382e None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.431255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abd5d2-3440-4399-bbd0-f62a684a382e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.431651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abd5d2-3440-4399-bbd0-f62a684a382e None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.432949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 819/1618] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:39.433964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 800/1619] 10.222.0.23 () {54 vars in 960 bytes} [Tue Mar 29 15:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:57:39.440585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513626-d0ed-4e7f-932d-471525f5cc90 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.440886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513626-d0ed-4e7f-932d-471525f5cc90 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.441169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59513626-d0ed-4e7f-932d-471525f5cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.446927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:39.492998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-59513626-d0ed-4e7f-932d-471525f5cc90 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:39.494333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-59513626-d0ed-4e7f-932d-471525f5cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.678033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c78e4-1ef4-4eae-aeda-c31590c7b015 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:39.695686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:39.696376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.696758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.700489 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.701882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.729861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.790075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 801/1620] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:39.797731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.798056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.798387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.826050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 820/1621] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/users => generated 292 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:39.827047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:39.853392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aa2fd-accc-42d1-8ff3-0b378051c661 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:39.865158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:39.866011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.866477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.868080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.874882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:39.879403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:39.921077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 802/1622] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Mar 29 15:57:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:39.923759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:39.952145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1316-7184-4385-9a80-3c0f6f33d227 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:39.953979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.955928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.964904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:39.966330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:39.967595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:39.969084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:39.970200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:39.973846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:39.981492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 821/1623] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:39.982501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:40.006033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 803/1624] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:40.008857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:40.022646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746e50-f9a4-4db2-8adc-4e8e8e5d554a service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:40.040592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357fc39-3798-480d-a068-bf707864e983 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:40.043440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0862a5b-aa9c-4236-99a0-96b74108d4f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:40.044154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862a5b-aa9c-4236-99a0-96b74108d4f7 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.044438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862a5b-aa9c-4236-99a0-96b74108d4f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.044712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0862a5b-aa9c-4236-99a0-96b74108d4f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.065024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:40.068754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.069610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.071933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] PATH_INFO: `/v3/projects/59e0513fd15a41a39abf5f56cea24161/users/6c8bb1c257e44638a48127b08fc76c0c/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.118887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e0513fd15a41a39abf5f56cea24161, user_id=6c8bb1c257e44638a48127b08fc76c0c, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:40.124135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:40.153938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 804/1625] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:40 2022] PUT /identity/v3/projects/59e0513fd15a41a39abf5f56cea24161/users/6c8bb1c257e44638a48127b08fc76c0c/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:57:40.160119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:40.225843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0862a5b-aa9c-4236-99a0-96b74108d4f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:40.229209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0862a5b-aa9c-4236-99a0-96b74108d4f7 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:40.249677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 822/1626] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:40.321226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063c43-423f-4150-ae7c-e005f48ee33d None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.321735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063c43-423f-4150-ae7c-e005f48ee33d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.322167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063c43-423f-4150-ae7c-e005f48ee33d None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.324268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 823/1627] 10.222.0.23 () {54 vars in 912 bytes} [Tue Mar 29 15:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:57:40.335017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba652-3a3c-4b27-a02a-86badc83f437 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:40.340977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.341268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.341490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:40.342172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.343984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.343984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.344279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.346033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:40.348389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:40.362907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 805/1628] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:40.366758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:40.371851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:40.373089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:40.415327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f5f1-c317-4255-8492-2af702ab1d6d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:40.433102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579beda-3dc4-4717-a607-536622d25cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:40.434607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579beda-3dc4-4717-a607-536622d25cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.436157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579beda-3dc4-4717-a607-536622d25cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.436479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579beda-3dc4-4717-a607-536622d25cf1 admin admin] PATH_INFO: `/v3/projects/59e0513fd15a41a39abf5f56cea24161/users/6c8bb1c257e44638a48127b08fc76c0c/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.438771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579beda-3dc4-4717-a607-536622d25cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e0513fd15a41a39abf5f56cea24161, user_id=6c8bb1c257e44638a48127b08fc76c0c, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:40.441583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579beda-3dc4-4717-a607-536622d25cf1 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:40.453645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 806/1629] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:40 2022] PUT /identity/v3/projects/59e0513fd15a41a39abf5f56cea24161/users/6c8bb1c257e44638a48127b08fc76c0c/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:40.475878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da553d5-0309-4c2f-b989-9d83e3110c37 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.476258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da553d5-0309-4c2f-b989-9d83e3110c37 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.476614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da553d5-0309-4c2f-b989-9d83e3110c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.521059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1da553d5-0309-4c2f-b989-9d83e3110c37 None None] MFA Rules not processed for user `6c8bb1c257e44638a48127b08fc76c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:40.522738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1da553d5-0309-4c2f-b989-9d83e3110c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:40.559906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 824/1630] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:57:40.570012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:40.669011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 807/1631] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:40.672310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc403c-aa18-4162-9d63-f398240c28a7 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.672604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc403c-aa18-4162-9d63-f398240c28a7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.674400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc403c-aa18-4162-9d63-f398240c28a7 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.679216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 808/1632] 10.222.0.23 () {54 vars in 912 bytes} [Tue Mar 29 15:57:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:57:40.680178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc403c-aa18-4162-9d63-f398240c28a7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:40.697472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222a36f-74c1-47f1-a6ac-a5b491f65161 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:40.765870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc403c-aa18-4162-9d63-f398240c28a7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:40.771240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3218-31d4-4713-8606-e3b9a5db4f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:40.773691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3218-31d4-4713-8606-e3b9a5db4f03 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.774010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3218-31d4-4713-8606-e3b9a5db4f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.774304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3218-31d4-4713-8606-e3b9a5db4f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.788767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed3218-31d4-4713-8606-e3b9a5db4f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:40.791008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed3218-31d4-4713-8606-e3b9a5db4f03 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:40.804487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 809/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:40.805886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.806177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.806463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.826520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:40.826787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:40.827194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:40.827481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:40.827783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:40.827978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:40.960004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 810/1634] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:40.970744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:40.972517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:41.008499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 825/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:41.029797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:41.042995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d06d20-39f6-44d2-bdab-02e889837c6a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:41.047793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2e5cf-7287-41a4-b43d-8c706bad6290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:41.048855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2e5cf-7287-41a4-b43d-8c706bad6290 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:41.049756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2e5cf-7287-41a4-b43d-8c706bad6290 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:41.050790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2e5cf-7287-41a4-b43d-8c706bad6290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:41.066965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2e5cf-7287-41a4-b43d-8c706bad6290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:41.069287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2e5cf-7287-41a4-b43d-8c706bad6290 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:41.089074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 811/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:57:41.591828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:41.605916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec251cd-1985-4b05-afb5-392e0dc81d4e service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:41.621290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6965b39-cbd8-436b-84fc-86a9909b7d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:41.622325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965b39-cbd8-436b-84fc-86a9909b7d96 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:41.622833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965b39-cbd8-436b-84fc-86a9909b7d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:41.623369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6965b39-cbd8-436b-84fc-86a9909b7d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:41.806738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965b39-cbd8-436b-84fc-86a9909b7d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:41.810612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6965b39-cbd8-436b-84fc-86a9909b7d96 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:41.853335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 826/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:42.646409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:42.647402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:42.647629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:42.735358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] MFA Rules not processed for user `121a7604047f47bd8ce4f490f51348b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:42.737472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:42.910519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 812/1638] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:42.925315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b6ad3-b3ea-46f2-bb57-e47d2d0d0c1c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:42.925834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b6ad3-b3ea-46f2-bb57-e47d2d0d0c1c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:42.927022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b6ad3-b3ea-46f2-bb57-e47d2d0d0c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:42.950467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-543b6ad3-b3ea-46f2-bb57-e47d2d0d0c1c None None] MFA Rules not processed for user `121a7604047f47bd8ce4f490f51348b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:42.954131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-543b6ad3-b3ea-46f2-bb57-e47d2d0d0c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:42.984633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 827/1639] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:42.985230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:43.002709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e321b3-ef20-433f-8b07-dfa70cc881ae None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:43.011733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c338b4-965c-4e7b-bae3-84fd13f79bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:43.013807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c338b4-965c-4e7b-bae3-84fd13f79bf2 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:43.014396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c338b4-965c-4e7b-bae3-84fd13f79bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:43.014896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c338b4-965c-4e7b-bae3-84fd13f79bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:43.026142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c338b4-965c-4e7b-bae3-84fd13f79bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:43.030727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c338b4-965c-4e7b-bae3-84fd13f79bf2 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:43.054778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 813/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:57:43.901914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963a021-9f0d-48a7-b729-bc3e3dd13ea7 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:43.901914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963a021-9f0d-48a7-b729-bc3e3dd13ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:43.903195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963a021-9f0d-48a7-b729-bc3e3dd13ea7 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:43.913041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 828/1641] 10.222.0.23 () {54 vars in 912 bytes} [Tue Mar 29 15:57:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:57:43.943595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2d49-0b63-4cfa-b0d1-ded1d05a0f59 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:43.946937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2d49-0b63-4cfa-b0d1-ded1d05a0f59 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:43.948930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2d49-0b63-4cfa-b0d1-ded1d05a0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:44.048082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-61db2d49-0b63-4cfa-b0d1-ded1d05a0f59 None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:44.054052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-61db2d49-0b63-4cfa-b0d1-ded1d05a0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:44.225304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 814/1642] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:57:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:44.258355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963a021-9f0d-48a7-b729-bc3e3dd13ea7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:44.292314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963a021-9f0d-48a7-b729-bc3e3dd13ea7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:44.298381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1424d5f-7c3f-43e3-9bd7-ef8c38068c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:44.299472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1424d5f-7c3f-43e3-9bd7-ef8c38068c97 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:44.299967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1424d5f-7c3f-43e3-9bd7-ef8c38068c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:44.301129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1424d5f-7c3f-43e3-9bd7-ef8c38068c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:44.323838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1424d5f-7c3f-43e3-9bd7-ef8c38068c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:44.325873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1424d5f-7c3f-43e3-9bd7-ef8c38068c97 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:44.348530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 829/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:45.926926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5cfc6-2b21-458f-94d1-feded85feaa7 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:45.928379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5cfc6-2b21-458f-94d1-feded85feaa7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:45.929446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5cfc6-2b21-458f-94d1-feded85feaa7 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:45.931515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 815/1644] 10.222.0.23 () {54 vars in 960 bytes} [Tue Mar 29 15:57:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:57:45.938133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c7261-f3ad-40a4-980b-a92c82d201b6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:45.939510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c7261-f3ad-40a4-980b-a92c82d201b6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:45.939998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c7261-f3ad-40a4-980b-a92c82d201b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:45.968161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d77c7261-f3ad-40a4-980b-a92c82d201b6 None None] MFA Rules not processed for user `43182ee871284e7c919f8dfc4f39fa79`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:45.970186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d77c7261-f3ad-40a4-980b-a92c82d201b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:46.165979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 830/1645] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Mar 29 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:57:46.173727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5cfc6-2b21-458f-94d1-feded85feaa7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:46.218390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5cfc6-2b21-458f-94d1-feded85feaa7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:46.225982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:46.227343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:46.228029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:46.228532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:46.230658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:46.248365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:46.251140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401917-eb8d-4112-9581-21447eb1ee8f service placement] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:46.276542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 816/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:47.390214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:47.391864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:47.392366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:47.440957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] MFA Rules not processed for user `6ecde8d802f04ab7bde761e9a0e6b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:47.442239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:47.602826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 831/1647] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:47.614486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220294c-2393-4880-82d2-193902dcfc73 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:47.615485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220294c-2393-4880-82d2-193902dcfc73 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:47.615935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220294c-2393-4880-82d2-193902dcfc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:47.647353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-4220294c-2393-4880-82d2-193902dcfc73 None None] MFA Rules not processed for user `6ecde8d802f04ab7bde761e9a0e6b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:47.648605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4220294c-2393-4880-82d2-193902dcfc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:47.674412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 817/1648] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:47.688501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:47.712097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed6d43-7645-43c3-83fd-541eb7aaf321 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:47.737166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3efe-a18b-4408-a06e-a6d95dea9e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:47.738724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3efe-a18b-4408-a06e-a6d95dea9e1e service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:47.739214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3efe-a18b-4408-a06e-a6d95dea9e1e service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:47.739735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3efe-a18b-4408-a06e-a6d95dea9e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:47.757071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3efe-a18b-4408-a06e-a6d95dea9e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:47.759592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3efe-a18b-4408-a06e-a6d95dea9e1e service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:47.790317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 832/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:49.593400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:49.593894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:49.593962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:49.662375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] MFA Rules not processed for user `6ecde8d802f04ab7bde761e9a0e6b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:49.663725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:49.690116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 818/1650] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:50.302086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:50.303081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:50.303704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:50.328237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:50.330235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:50.459876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 833/1651] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:57:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:57:50.843868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:50.845288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:50.997656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d781b-fa24-47cc-87fe-d6cdf7a44bd0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:51.009514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2232184-954f-4dfc-b840-76837340c455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:51.010544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232184-954f-4dfc-b840-76837340c455 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:51.010979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232184-954f-4dfc-b840-76837340c455 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:51.011430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2232184-954f-4dfc-b840-76837340c455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:51.028807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2232184-954f-4dfc-b840-76837340c455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:51.030678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2232184-954f-4dfc-b840-76837340c455 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:51.053303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 819/1652] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 15:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 15:57:52.121463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:52.294487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bea654-d434-4341-a9cf-d7d531d57ff6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:52.302242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:52.304061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:52.304499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:52.304965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] PATH_INFO: `/v3/users/e94093b0845649eabd9ef006b1313431` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:52.307075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94093b0845649eabd9ef006b1313431)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:52.310058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:52.415941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94093b0845649eabd9ef006b1313431'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:52.418032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94093b0845649eabd9ef006b1313431'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:52.483799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94093b0845649eabd9ef006b1313431'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:52.495561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94093b0845649eabd9ef006b1313431'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:52.498117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94093b0845649eabd9ef006b1313431'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:52.523335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 834/1653] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:57:52 2022] DELETE /identity/v3/users/e94093b0845649eabd9ef006b1313431 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:52.530433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149b9c-433a-4d63-9ace-5fbcbae4e04a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:52.531374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149b9c-433a-4d63-9ace-5fbcbae4e04a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:52.531841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149b9c-433a-4d63-9ace-5fbcbae4e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:52.581505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-95149b9c-433a-4d63-9ace-5fbcbae4e04a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:52.583148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-95149b9c-433a-4d63-9ace-5fbcbae4e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:52.735974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 820/1654] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:52.749521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:52.753410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:52.946590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31235d-0dbc-47c7-88cd-4964b5f06b7a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:52.946590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dffc72-6461-4dc6-9d5c-69bb3d030c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:52.946590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dffc72-6461-4dc6-9d5c-69bb3d030c12 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:52.946590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dffc72-6461-4dc6-9d5c-69bb3d030c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:52.946857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dffc72-6461-4dc6-9d5c-69bb3d030c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:52.992475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dffc72-6461-4dc6-9d5c-69bb3d030c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:52.993979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dffc72-6461-4dc6-9d5c-69bb3d030c12 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:53.014270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 835/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:53.666446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:53.667110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:53.667321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:53.705236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:53.706190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:53.706629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:53.729825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] MFA Rules not processed for user `23a85c0f0bff4056af1d8f6691da236c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:53.734362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:53.780938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] MFA Rules not processed for user `fc9110431b1c4a919cfe4ecd7d4016dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:53.782166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:53.897846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 821/1656] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:53.923389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 836/1657] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:53.952269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:53.953892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:54.016455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:54.021532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:54.098707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3e05d-18e2-459c-9884-ce4872d5587b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:54.119910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:54.120582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.120872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.121219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.152382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:54.156729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:54.182700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 822/1658] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:54.191549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:54.201644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:54.224339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1e558-c93e-4326-a1d3-073276f65174 service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:54.243378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:54.244697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.245613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.246037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] PATH_INFO: `/v3/projects/a9ae60bd4d8b4687945728a86db9334a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.248456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ae60bd4d8b4687945728a86db9334a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:54.250580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:54.280828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e378df-b9b7-4891-808c-5f85521cf9e6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:54.288284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de5840-46b0-4421-a62d-71dd34a55730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:54.289392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5840-46b0-4421-a62d-71dd34a55730 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.290036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5840-46b0-4421-a62d-71dd34a55730 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.290929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de5840-46b0-4421-a62d-71dd34a55730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.309018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de5840-46b0-4421-a62d-71dd34a55730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:54.312867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de5840-46b0-4421-a62d-71dd34a55730 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:54.328410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ae60bd4d8b4687945728a86db9334a', 'request_id': 'req-d26bd391-5da7-4cbb-ab08-3e84229ef590'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:54.329146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 837/1659] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:54.337430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ae60bd4d8b4687945728a86db9334a', 'request_id': 'req-d26bd391-5da7-4cbb-ab08-3e84229ef590'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:54.344185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ae60bd4d8b4687945728a86db9334a', 'request_id': 'req-d26bd391-5da7-4cbb-ab08-3e84229ef590'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:54.360090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] The token cache is being invalidate because project a9ae60bd4d8b4687945728a86db9334a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:57:54.360399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:54.361096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d26bd391-5da7-4cbb-ab08-3e84229ef590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:54.363344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 823/1660] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:57:54 2022] DELETE /identity/v3/projects/a9ae60bd4d8b4687945728a86db9334a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:54.370000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.371507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.371983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.437413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:54.438899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:54.600136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 838/1661] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:54.608384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.609077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.609864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.647459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:54.656161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:54.671062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 824/1662] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:54.675336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:54.689220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c4a04-80df-43e4-9089-89f4bea5a712 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:54.708037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:54.708717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.709097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.709462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.710267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:57:54.712323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:54.714071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:54.756085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 839/1663] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:57:54.758474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:54.771384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb66eba-8537-4145-98d9-4d07cde03ff0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:54.783015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:54.783818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.784356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.785434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.786373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:54.792947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:54.845130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 825/1664] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:54 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:57:54.849379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:54.862123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0469b7-10c0-407f-8c69-89cf30995298 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:54.989408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:54.990097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:54.990391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:54.990665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:54.991352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:54.993347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:55.042770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:55.044831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 840/1665] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:54 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:55.057509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b125e9c-875c-44c1-87a6-881ecec298c4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:55.077542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:55.078917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:55.079887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:55.081034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:55.092089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:55.092089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:55.127452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 826/1666] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:55.131437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:55.145186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1873-edc4-4d44-bb4a-5206f570730c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:55.159723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163e5e3-233c-461c-b2c4-b0fd79bf3a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:55.163768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163e5e3-233c-461c-b2c4-b0fd79bf3a2e admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:55.164296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163e5e3-233c-461c-b2c4-b0fd79bf3a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:55.165876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163e5e3-233c-461c-b2c4-b0fd79bf3a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:55.166859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163e5e3-233c-461c-b2c4-b0fd79bf3a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:55.169500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163e5e3-233c-461c-b2c4-b0fd79bf3a2e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:55.195095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 841/1667] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:57:55.198823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:55.213470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee86a96-c3ca-4e61-b196-382795836ef5 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:55.223923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:55.226192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:55.227229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:55.228296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] PATH_INFO: `/v3/projects/e93732b7519943c0af3997878af81d89/users/bfa274de79aa4ca6bd3e1ba650254a1a/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:55.295134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93732b7519943c0af3997878af81d89, user_id=bfa274de79aa4ca6bd3e1ba650254a1a, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:55.302934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:55.345293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 827/1668] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:55 2022] PUT /identity/v3/projects/e93732b7519943c0af3997878af81d89/users/bfa274de79aa4ca6bd3e1ba650254a1a/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:55.355108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d27e-a270-48bc-b8c9-5607eb4a3096 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:55.355403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d27e-a270-48bc-b8c9-5607eb4a3096 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:55.355711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077d27e-a270-48bc-b8c9-5607eb4a3096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:55.477057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8077d27e-a270-48bc-b8c9-5607eb4a3096 None None] MFA Rules not processed for user `bfa274de79aa4ca6bd3e1ba650254a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:55.480016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8077d27e-a270-48bc-b8c9-5607eb4a3096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:55.658128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 842/1669] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:55.663151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:55.788866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:55.789512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:55.789512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:55.835776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:55.837841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:55.886337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39cace-3013-491e-87b7-e2037f6947c4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:55.923099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:55.928826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:55.929705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:55.930928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:55.937577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:55.954870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:56.016583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 843/1670] 10.222.0.55 () {58 vars in 1015 bytes} [Tue Mar 29 15:57:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:56.043907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:56.045416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:56.060397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b384305-4fd0-45ff-88f3-cdeb21e0a598 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:56.068327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:56.069107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:56.069263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:56.069534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:56.094746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 828/1671] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:57:55 2022] POST /identity/v3/projects => generated 385 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:56.098096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:56.107417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:56.108930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:56.140888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 844/1672] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:56.353089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bb539-b479-4b7e-a0fe-a81c0aa0fc29 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:56.376860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:56.378180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:56.379835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:56.381251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:56.383940 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:56.387124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:56.457248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:56.463941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 829/1673] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:57:56 2022] POST /identity/v3/users => generated 299 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:57:56.492015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5045-a2f7-4460-9c94-b58e62b77ff7 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:56.535664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:56.536313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:56.536536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:56.536810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:56.537536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:56.539186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:56.631669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 845/1674] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:57:56.633915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:56.647355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe01211-c2c8-4d54-844e-bec3ac9edb43 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:56.689567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:56.691213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:56.693643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:56.694091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] PATH_INFO: `/v3/projects/3a23c568e26e4178a7a5a1ae7d1dbd9f/users/a7c42ee9c191426ab98d89c6271df985/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:56.717627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a23c568e26e4178a7a5a1ae7d1dbd9f, user_id=a7c42ee9c191426ab98d89c6271df985, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:56.721578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:56.785891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 830/1675] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:56 2022] PUT /identity/v3/projects/3a23c568e26e4178a7a5a1ae7d1dbd9f/users/a7c42ee9c191426ab98d89c6271df985/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:56.790290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:56.802830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36d89-8963-422f-83bf-2f6b0b7d8d30 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:57.141217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3570df3-a478-4eeb-820e-872d41521952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:57.143578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570df3-a478-4eeb-820e-872d41521952 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:57.146907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570df3-a478-4eeb-820e-872d41521952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:57.147317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3570df3-a478-4eeb-820e-872d41521952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:57.148212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3570df3-a478-4eeb-820e-872d41521952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:57.150235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3570df3-a478-4eeb-820e-872d41521952 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:57.190051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 846/1676] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:57:57.194160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:57.214165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5e01-ae49-4156-8380-fa1b67fdea00 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:57.240040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:57.240809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:57.241159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:57.241435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] PATH_INFO: `/v3/projects/3a23c568e26e4178a7a5a1ae7d1dbd9f/users/a7c42ee9c191426ab98d89c6271df985/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:57.248015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a23c568e26e4178a7a5a1ae7d1dbd9f, user_id=a7c42ee9c191426ab98d89c6271df985, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:57.250690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:57.289728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 831/1677] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:57:57 2022] PUT /identity/v3/projects/3a23c568e26e4178a7a5a1ae7d1dbd9f/users/a7c42ee9c191426ab98d89c6271df985/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:57:57.301396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:57.301691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:57.301965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:57.408540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] MFA Rules not processed for user `a7c42ee9c191426ab98d89c6271df985`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:57.409803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:57.601062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:57.603142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:57.742743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 847/1678] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:57.765775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:57.770853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:57.846028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d6d3-1717-4d05-bfd2-5fbcccd0396a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:57.855212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:57.856290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:57.856618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:57.857691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] PATH_INFO: `/v3/users/c5667b1028f34b5d8da72bb300f5735a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:57.859422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5667b1028f34b5d8da72bb300f5735a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:57.864548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: WARNING py.warnings [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:57:57.864548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: warnings.warn(msg) Mar 29 15:57:57.864548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: Mar 29 15:57:57.865881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:57.908929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ed5fc-49b7-4f58-affc-272f687a8051 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:57.919175 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:57.920107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:57.921975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:57.922429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:57.944067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:57.946252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:57.989450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 848/1679] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:57:58.061053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5667b1028f34b5d8da72bb300f5735a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.084713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5667b1028f34b5d8da72bb300f5735a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.123970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5667b1028f34b5d8da72bb300f5735a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.125358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5667b1028f34b5d8da72bb300f5735a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.154950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:58.157187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b2874ce3-7241-437c-8975-76e20261d084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5667b1028f34b5d8da72bb300f5735a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.169979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 832/1680] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:57:57 2022] DELETE /identity/v3/users/c5667b1028f34b5d8da72bb300f5735a => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:57:58.174535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:58.175068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:58.175679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:58.177828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8964814-f6d6-49d2-8ba5-1cce2f8ccbb4 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:58.217680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:58.220732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:58.392559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 833/1681] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:58.439703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:58.445669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:58.449570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:58.449570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] PATH_INFO: `/v3/users/bfa274de79aa4ca6bd3e1ba650254a1a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:58.451225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa274de79aa4ca6bd3e1ba650254a1a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:58.456356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:58.471025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:58.472631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:58.575961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa274de79aa4ca6bd3e1ba650254a1a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.578505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa274de79aa4ca6bd3e1ba650254a1a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.601725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa274de79aa4ca6bd3e1ba650254a1a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.616289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa274de79aa4ca6bd3e1ba650254a1a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.618317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a51f9f42-6636-4aa5-9d1e-a51b8509cff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa274de79aa4ca6bd3e1ba650254a1a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:58.688496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8f573-07c0-48e1-a7d6-892993fed3df None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:58.701315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 849/1682] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:57:58 2022] DELETE /identity/v3/users/bfa274de79aa4ca6bd3e1ba650254a1a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:58.703745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:58.703745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:58.704036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:58.704479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:58.707607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:58.708012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:58.708392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:58.710665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:58.756779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:58.758468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:58.767963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:58.773492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:58.802285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 834/1683] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:57:58.925043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 850/1684] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:57:59.051486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:59.053279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:59.070449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6cac6-6bcc-461d-aad8-cf72be7bcb77 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:59.193887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9550ddd-4fae-4882-b5b9-f068d2633008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:59.194560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9550ddd-4fae-4882-b5b9-f068d2633008 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:59.194866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9550ddd-4fae-4882-b5b9-f068d2633008 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:59.195120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9550ddd-4fae-4882-b5b9-f068d2633008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:59.213460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9550ddd-4fae-4882-b5b9-f068d2633008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:59.214941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9550ddd-4fae-4882-b5b9-f068d2633008 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:59.242014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 835/1685] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:57:59.570810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:57:59.597062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:57:59.655465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa0bed-75ab-41ab-8a27-60fdaf4bb284 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:57:59.668537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:57:59.671177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:59.671468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:59.671822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] PATH_INFO: `/v3/users/5fd0081eadf440078063c7a260f5bc6b` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:59.676734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd0081eadf440078063c7a260f5bc6b)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:57:59.683869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:57:59.814020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd0081eadf440078063c7a260f5bc6b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:59.816715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd0081eadf440078063c7a260f5bc6b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:59.871468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd0081eadf440078063c7a260f5bc6b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:59.885873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd0081eadf440078063c7a260f5bc6b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:59.886501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd0081eadf440078063c7a260f5bc6b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:57:59.941866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 851/1686] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:57:59 2022] DELETE /identity/v3/users/5fd0081eadf440078063c7a260f5bc6b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:57:59.943920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:57:59.944374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:57:59.944688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:57:59.985995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:57:59.991202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:00.111852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:00.113418 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:00.205144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 836/1687] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:00.224756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:00.226148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:00.309104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0cfd8-692a-4df4-ad2d-18a6453f8aed admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:00.328052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:00.329148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:00.329267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:00.329509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] PATH_INFO: `/v3/projects/49d2909e43fa4508af3151a299a86de4` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:00.336098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d2909e43fa4508af3151a299a86de4)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:00.339401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: WARNING py.warnings [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 29 15:58:00.339401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: warnings.warn(msg) Mar 29 15:58:00.339401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: Mar 29 15:58:00.346237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:00.422257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4431d5-7a8c-41af-b77f-4d5c1a464113 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:00.438445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735232c-3580-4ec5-82ab-ce8d2c6fbbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:00.443335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735232c-3580-4ec5-82ab-ce8d2c6fbbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:00.443767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735232c-3580-4ec5-82ab-ce8d2c6fbbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:00.444057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735232c-3580-4ec5-82ab-ce8d2c6fbbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:00.477819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735232c-3580-4ec5-82ab-ce8d2c6fbbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:00.479395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735232c-3580-4ec5-82ab-ce8d2c6fbbf4 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:00.527297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 837/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:00.546413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d2909e43fa4508af3151a299a86de4', 'request_id': 'req-10091734-c1b1-44be-9def-8efe2f0a9345'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:00.583161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d2909e43fa4508af3151a299a86de4', 'request_id': 'req-10091734-c1b1-44be-9def-8efe2f0a9345'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:00.593770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d2909e43fa4508af3151a299a86de4', 'request_id': 'req-10091734-c1b1-44be-9def-8efe2f0a9345'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:00.618441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] The token cache is being invalidate because project 49d2909e43fa4508af3151a299a86de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:00.619201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:00.620901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-10091734-c1b1-44be-9def-8efe2f0a9345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:00.627583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 852/1689] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:00 2022] DELETE /identity/v3/projects/49d2909e43fa4508af3151a299a86de4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:00.629789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:00.630273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:00.630601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:00.689185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:00.690524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:00.831576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 838/1690] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:00.842507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:00.842507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:00.842507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:00.890531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:00.894666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:00.923190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 853/1691] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:00.924645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:00.956211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b57e-28d5-4c4f-b364-8ca3017cd23e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:00.984296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:00.986322 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:00.986625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:00.986909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:00.987972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:00.988290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:01.006684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:01.090804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 839/1692] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:58:01.091125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:01.108847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174991c-dbf1-45d0-80a3-4e15056b89de None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:01.139158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:01.139911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:01.140367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:01.140697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:01.141517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:01.149864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:01.236882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 854/1693] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:01 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:01.242633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:01.266178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e50b5-c64d-4cd4-aad8-c17c455f006f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:01.487134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:01.487935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:01.488161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:01.488446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:01.489199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:01.494752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:01.534507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 840/1694] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:01 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:01.539018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:01.555578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da634e2-5202-45b5-8162-ae4b78424e39 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:01.578053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:01.578913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:01.579209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:01.579689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:01.591451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:01.603766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:01.646050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 855/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:01.648574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:01.668591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010129d-2e5e-4718-a60d-01ed1896ede4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:01.682881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2adf93-bda9-4db1-a6b8-19319a47ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:01.685044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2adf93-bda9-4db1-a6b8-19319a47ce5a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:01.685341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2adf93-bda9-4db1-a6b8-19319a47ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:01.685624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2adf93-bda9-4db1-a6b8-19319a47ce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:01.686389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2adf93-bda9-4db1-a6b8-19319a47ce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:01.699257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2adf93-bda9-4db1-a6b8-19319a47ce5a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:01.736444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:01.740686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 841/1696] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:01.775540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa02cb-715c-4435-8099-adf8fe03df0f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:01.793840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:01.795248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:01.795833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:01.796670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] PATH_INFO: `/v3/projects/97a1e5220e054a5ba8cac53f901cfed9/users/89af78e816a9401fb17d82208cce61ae/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:01.831695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a1e5220e054a5ba8cac53f901cfed9, user_id=89af78e816a9401fb17d82208cce61ae, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:01.838495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:01.864925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 856/1697] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:01 2022] PUT /identity/v3/projects/97a1e5220e054a5ba8cac53f901cfed9/users/89af78e816a9401fb17d82208cce61ae/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:01.876021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:01.876330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:01.876571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:01.927425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] MFA Rules not processed for user `89af78e816a9401fb17d82208cce61ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:01.928707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:02.098280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 842/1698] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:02.103279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:02.406312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d8ba-6320-41d9-a4d6-ef8dcfcb9a72 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:02.424384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:02.425115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:02.425368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:02.425650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:02.426371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:02.436985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:02.522094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 857/1699] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:02 2022] POST /identity/v3/projects => generated 363 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:02.523740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:02.547627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2343e28-6c8c-4ef3-a0bd-83275ad06109 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:02.701880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:02.705169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:02.705493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:02.705780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:02.722605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:02.727543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:02.735828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:02.737747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:02.770198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d097c9b-5ad9-4123-b97e-36550b11c5f0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:02.773807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 843/1700] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:02 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:02.778448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:02.799087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:02.800099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:02.800387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:02.800668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] PATH_INFO: `/v3/projects/6f18a03531a148439d234ae6b755c6e3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:02.804676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f18a03531a148439d234ae6b755c6e3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:02.808981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:02.812057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265ea5b-dbc3-4509-b743-0f905834df8f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:02.830053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:02.833467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:02.833936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:02.834370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:02.835323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:02.838141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:02.886900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 844/1701] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:02.888655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:02.919572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d792f5-5b2c-4726-a2a9-597196f79885 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:02.972899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f18a03531a148439d234ae6b755c6e3', 'request_id': 'req-3c0b88b6-7030-425c-b0af-137ac8f7f981'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.006731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f18a03531a148439d234ae6b755c6e3', 'request_id': 'req-3c0b88b6-7030-425c-b0af-137ac8f7f981'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.045713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f18a03531a148439d234ae6b755c6e3', 'request_id': 'req-3c0b88b6-7030-425c-b0af-137ac8f7f981'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.085541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:03.086888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.087347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.087804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] PATH_INFO: `/v3/projects/8b3f12e259e04bd4a19aacb02f216e59/users/47cda606838c4650bb5c64a07b31dbab/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:03.119445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3f12e259e04bd4a19aacb02f216e59, user_id=47cda606838c4650bb5c64a07b31dbab, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:03.131725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:03.147502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] The token cache is being invalidate because project 6f18a03531a148439d234ae6b755c6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:03.149793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.153776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3c0b88b6-7030-425c-b0af-137ac8f7f981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.160835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 858/1702] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:02 2022] DELETE /identity/v3/projects/6f18a03531a148439d234ae6b755c6e3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:03.166067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f1206-698a-4384-a1c0-0491faf01b39 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.169629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f1206-698a-4384-a1c0-0491faf01b39 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.170437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f1206-698a-4384-a1c0-0491faf01b39 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:03.179594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 859/1703] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 15:58:03 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:58:03.188120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.188707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.189617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:03.206838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 845/1704] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:02 2022] PUT /identity/v3/projects/8b3f12e259e04bd4a19aacb02f216e59/users/47cda606838c4650bb5c64a07b31dbab/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:03.213182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:03.222492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:03.274167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:03.280023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:03.502553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278e6aa-3e43-49c0-85cb-953df17f8213 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:03.513483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 860/1705] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:03.515199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:03.521883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:03.543741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3941ec3-6846-4646-abff-81c8c3b34913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:03.546758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3941ec3-6846-4646-abff-81c8c3b34913 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.547732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3941ec3-6846-4646-abff-81c8c3b34913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.549351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3941ec3-6846-4646-abff-81c8c3b34913 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:03.550269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3941ec3-6846-4646-abff-81c8c3b34913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:03.561073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3941ec3-6846-4646-abff-81c8c3b34913 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:03.585158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf7fb7-f2a1-4138-ad79-cca32526a0de None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:03.591639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:03.593105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.593664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.594694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] PATH_INFO: `/v3/projects/e93732b7519943c0af3997878af81d89` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:03.598057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 846/1706] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:03.600007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.600605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.601083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:03.631309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93732b7519943c0af3997878af81d89)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:03.667541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:03.726412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:03.748513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:03.847300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93732b7519943c0af3997878af81d89', 'request_id': 'req-dacad2bd-c51b-4939-a411-65df69be5fa1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.857983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93732b7519943c0af3997878af81d89', 'request_id': 'req-dacad2bd-c51b-4939-a411-65df69be5fa1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.879613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93732b7519943c0af3997878af81d89', 'request_id': 'req-dacad2bd-c51b-4939-a411-65df69be5fa1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.941232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] The token cache is being invalidate because project e93732b7519943c0af3997878af81d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:03.941530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.949090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-dacad2bd-c51b-4939-a411-65df69be5fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:03.954866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 861/1707] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:03 2022] DELETE /identity/v3/projects/e93732b7519943c0af3997878af81d89 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:03.963406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:03.966011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:03.966553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.004655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 847/1708] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:04.005553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:04.009395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.045786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:04.049391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.065681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726d31c-4fe1-4229-9f91-7010329d8161 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:04.201239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 862/1709] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:04.203436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:04.205066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.217445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366a0c2-ded9-45cb-a19a-d999554b1bb5 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:04.222970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:04.224269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:04.224755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:04.225229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] PATH_INFO: `/v3/users/a7c42ee9c191426ab98d89c6271df985` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.226841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c42ee9c191426ab98d89c6271df985)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:04.229219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:04.241081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:04.242005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:04.242513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:04.265895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] PATH_INFO: `/v3/projects/8b3f12e259e04bd4a19aacb02f216e59/users/47cda606838c4650bb5c64a07b31dbab/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.269918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3f12e259e04bd4a19aacb02f216e59, user_id=47cda606838c4650bb5c64a07b31dbab, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:04.274156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:04.304340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 848/1710] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:04 2022] PUT /identity/v3/projects/8b3f12e259e04bd4a19aacb02f216e59/users/47cda606838c4650bb5c64a07b31dbab/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:04.304340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:04.307802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.394684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c42ee9c191426ab98d89c6271df985'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:04.395830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c42ee9c191426ab98d89c6271df985'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:04.431966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c42ee9c191426ab98d89c6271df985'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:04.445571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c42ee9c191426ab98d89c6271df985'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:04.446566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c42ee9c191426ab98d89c6271df985'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:04.492093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 863/1711] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:04 2022] DELETE /identity/v3/users/a7c42ee9c191426ab98d89c6271df985 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:04.493340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:04.495088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.583924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67085b0-84f0-4142-ac5a-e8049cddfd59 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:04.670165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8954032-61fa-46ae-afd3-8a08dcdfeceb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:04.681447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:04.682289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:04.682583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:04.682963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.683842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:04.685565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:04.689863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544ef2b-3d7a-40d3-8382-13841c4a6cb3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:04.707560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 864/1712] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:04.707560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:04.707560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:04.707560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.793810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] MFA Rules not processed for user `47cda606838c4650bb5c64a07b31dbab`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:04.797802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.833277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:04.834183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:04.838963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:04.843771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.850789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:04.896236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:04.897873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:04.941242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 849/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:04.948876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:04.977534 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbac023-26bd-4e02-91da-5e9b62e45897 service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:04.992852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:04.993828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:04.994568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:04.995058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:04.996020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:05.003916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:05.062976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 850/1714] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:04 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:05.064030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:05.070252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 865/1715] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:05.082975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:05.084889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:05.232649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0b301-3088-44e7-a1df-d4825bb5f406 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:05.267833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:05.268715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:05.269105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:05.269486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:05.270421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:05.272557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:05.356424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6236-7ec4-4cda-967e-31e716db94b1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:05.381125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 851/1716] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:05 2022] POST /identity/v3/users => generated 303 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:05.392512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:05.422005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5d75f-8574-4c39-af52-c6d660a8be11 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:05.457504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:05.458348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:05.458748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:05.459150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:05.460020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:05.462453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:05.464047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:05.465984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:05.466636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:05.467139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:05.495201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 852/1717] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:05.500639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:05.538889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601fa0-cc9e-4b80-81c2-bfe95f8ca82b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:05.559683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1bfbf-330a-4fca-a71b-f672a4783c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:05.560523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1bfbf-330a-4fca-a71b-f672a4783c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:05.560915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1bfbf-330a-4fca-a71b-f672a4783c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:05.561294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1bfbf-330a-4fca-a71b-f672a4783c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:05.562140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1bfbf-330a-4fca-a71b-f672a4783c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:05.566455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1bfbf-330a-4fca-a71b-f672a4783c3a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:05.568000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:05.570263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:05.591864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 866/1718] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:05.608294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 853/1719] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:05.612859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:05.630712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cd392-8086-4399-80b0-938436e0a95f service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:05.640510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:05.641706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:05.642474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:05.642980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] PATH_INFO: `/v3/projects/7c9ee0a897ee4e15a1d688b890d02df9/users/26b0eae6a587416e85623bf2c82a51f6/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:05.687882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9ee0a897ee4e15a1d688b890d02df9, user_id=26b0eae6a587416e85623bf2c82a51f6, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:05.701276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:05.764401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 867/1720] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:05 2022] PUT /identity/v3/projects/7c9ee0a897ee4e15a1d688b890d02df9/users/26b0eae6a587416e85623bf2c82a51f6/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:05.769274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:05.769575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:05.769856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:05.820979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:05.821943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:06.020527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 854/1721] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:06.071928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:06.073769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:06.210164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c4b4-7960-4ab1-8d23-42e3187d8001 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:06.226179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ee4ca-b38f-4f03-832d-cdfed054e86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:06.227497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ee4ca-b38f-4f03-832d-cdfed054e86a service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:06.228042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ee4ca-b38f-4f03-832d-cdfed054e86a service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:06.228488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ee4ca-b38f-4f03-832d-cdfed054e86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:06.257825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ee4ca-b38f-4f03-832d-cdfed054e86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:06.259967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ee4ca-b38f-4f03-832d-cdfed054e86a service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:06.303828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 868/1722] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:06.541238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:06.542694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:06.570594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb9eba-c8fc-4c3d-b35a-50e4f17bdb40 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:06.586501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:06.587779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:06.591028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:06.593832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] PATH_INFO: `/v3/users/89af78e816a9401fb17d82208cce61ae` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:06.597541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=89af78e816a9401fb17d82208cce61ae)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:06.604508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:06.805425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89af78e816a9401fb17d82208cce61ae'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:06.832146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89af78e816a9401fb17d82208cce61ae'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:06.889038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89af78e816a9401fb17d82208cce61ae'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:06.896212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89af78e816a9401fb17d82208cce61ae'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:06.909133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58c2d4f5-4ba7-430f-8bba-93879ac279dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89af78e816a9401fb17d82208cce61ae'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:06.916279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 855/1723] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:06 2022] DELETE /identity/v3/users/89af78e816a9401fb17d82208cce61ae => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:06.922004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:06.922483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:06.922869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:06.950616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3617-584e-49d9-93e1-1a2d4474a694 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:06.953363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3617-584e-49d9-93e1-1a2d4474a694 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:06.953919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3617-584e-49d9-93e1-1a2d4474a694 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:06.956376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 856/1724] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 15:58:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:58:06.975655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:06.977999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.039040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5344a9e-c45e-4ecd-8889-d1f0f775fd32 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:07.039478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5344a9e-c45e-4ecd-8889-d1f0f775fd32 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:07.039786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5344a9e-c45e-4ecd-8889-d1f0f775fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:07.100908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e5344a9e-c45e-4ecd-8889-d1f0f775fd32 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:07.103881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e5344a9e-c45e-4ecd-8889-d1f0f775fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.119287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 869/1725] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:07.143004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:07.145716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.286903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764c760-b4cb-4336-a013-247c17d23dbe None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:07.289211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 857/1726] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:07.290954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb8ed-f315-45c0-b26f-8e1cfaae599b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:07.290954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb8ed-f315-45c0-b26f-8e1cfaae599b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:07.291141 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb8ed-f315-45c0-b26f-8e1cfaae599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:07.293531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:07.294840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:07.295833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:07.296622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:07.315248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:07.318231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:07.330785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-36bbb8ed-f315-45c0-b26f-8e1cfaae599b None None] MFA Rules not processed for user `fc9110431b1c4a919cfe4ecd7d4016dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:07.332272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-36bbb8ed-f315-45c0-b26f-8e1cfaae599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.335119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 870/1727] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:07.376894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:07.378367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.397349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be7e2b-f5f4-4a61-a1c1-5a222e995b6a service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:07.405241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:07.406266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:07.406692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:07.407495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:07.418991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:07.423399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:07.425372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 858/1728] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:07.439842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 871/1729] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:07.481950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aca7f-aef1-4490-a8bb-50f74a415738 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:07.482256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aca7f-aef1-4490-a8bb-50f74a415738 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:07.482542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355aca7f-aef1-4490-a8bb-50f74a415738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:07.504353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-355aca7f-aef1-4490-a8bb-50f74a415738 None None] MFA Rules not processed for user `23a85c0f0bff4056af1d8f6691da236c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:07.506819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-355aca7f-aef1-4490-a8bb-50f74a415738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.589592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 859/1730] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:07.826584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:07.828117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:07.847031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb972-072e-4d76-b571-ba822e3af736 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:07.852731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:07.853750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:07.854035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:07.854699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] PATH_INFO: `/v3/projects/3a23c568e26e4178a7a5a1ae7d1dbd9f` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:07.862561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a23c568e26e4178a7a5a1ae7d1dbd9f)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:07.865518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:07.972527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a23c568e26e4178a7a5a1ae7d1dbd9f', 'request_id': 'req-55902327-e955-4b94-a1ae-d86f9d3e5b7a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:07.982713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a23c568e26e4178a7a5a1ae7d1dbd9f', 'request_id': 'req-55902327-e955-4b94-a1ae-d86f9d3e5b7a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:07.989912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a23c568e26e4178a7a5a1ae7d1dbd9f', 'request_id': 'req-55902327-e955-4b94-a1ae-d86f9d3e5b7a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:08.009036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] The token cache is being invalidate because project 3a23c568e26e4178a7a5a1ae7d1dbd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:08.009339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:08.010243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-55902327-e955-4b94-a1ae-d86f9d3e5b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:08.012621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 872/1731] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:07 2022] DELETE /identity/v3/projects/3a23c568e26e4178a7a5a1ae7d1dbd9f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:08.018098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb28db-802e-4414-9d94-42a6f33b9413 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.018598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb28db-802e-4414-9d94-42a6f33b9413 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.018734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb28db-802e-4414-9d94-42a6f33b9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.065404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-02fb28db-802e-4414-9d94-42a6f33b9413 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:08.067552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-02fb28db-802e-4414-9d94-42a6f33b9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:08.151703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 860/1732] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:08.152673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85b7d3-6717-441d-83f9-e33a742d0990 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.153229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85b7d3-6717-441d-83f9-e33a742d0990 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.153731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85b7d3-6717-441d-83f9-e33a742d0990 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.155329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.155449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 873/1733] 10.222.0.23 () {54 vars in 912 bytes} [Tue Mar 29 15:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:58:08.155887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.156327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.162015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.162301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.162787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.183145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:08.185149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:08.190028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:08.191865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:08.203700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 861/1734] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:08.207172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.216421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966a51f-a463-4029-b65a-4832e6c87b5d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.227554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.228509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.228864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.229251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.230120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:08.230531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.232545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.254940 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 862/1735] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:58:08.256412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.268341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 874/1736] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:08.270575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5d38-27bf-460f-be51-5a789579eec8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.280545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.281360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.281806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.282674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.284105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.285654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.286366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.287205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:08.302180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2f809-7b9f-43c1-9c82-1d85be16da4a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.310163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.311675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.312225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.313339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.326331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.327949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.329510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 863/1737] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:08.331193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.349774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 875/1738] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:08.473506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24df28-fd62-4ab3-a525-b5e031ba91c4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.481177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.482053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.482442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.482821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.483666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.489170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.525970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 864/1739] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:08.526304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.543728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1fe42-24af-4c00-882b-102b7fefc3ed service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.550720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.551437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.551769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.552050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.552829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.556185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.571960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 876/1740] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:08.573693 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.587959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b0599-abbb-4d33-a207-2e79959ec6c7 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.597499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e1dd3-50c7-40f6-85e5-392c05af6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.598459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1dd3-50c7-40f6-85e5-392c05af6ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.598812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1dd3-50c7-40f6-85e5-392c05af6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.599088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e1dd3-50c7-40f6-85e5-392c05af6ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.600177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e1dd3-50c7-40f6-85e5-392c05af6ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.603146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e1dd3-50c7-40f6-85e5-392c05af6ecd admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.615384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 865/1741] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:08.619917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.632594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d2b2e-3c30-48e8-99df-fb5293b9fc1d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.638397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.639429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.639959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.640230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] PATH_INFO: `/v3/projects/5e1f95fe3aae4ca4b43f7b46e5cf9e9e/users/1dde04c23f524fc4b956eceb24475eb3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.669154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1f95fe3aae4ca4b43f7b46e5cf9e9e, user_id=1dde04c23f524fc4b956eceb24475eb3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:08.672444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:08.693834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 877/1742] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:08 2022] PUT /identity/v3/projects/5e1f95fe3aae4ca4b43f7b46e5cf9e9e/users/1dde04c23f524fc4b956eceb24475eb3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:08.699498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.699832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.700118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.738011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] MFA Rules not processed for user `1dde04c23f524fc4b956eceb24475eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:08.740761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:08.809758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.813495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:08.850248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 866/1743] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:08.851195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:08.979761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7f0d6-9ca4-4573-9b21-a66da03e6db9 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:08.994035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:08.995298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:08.996346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:08.997558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] PATH_INFO: `/v3/projects/97a1e5220e054a5ba8cac53f901cfed9` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:08.999295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fb21f-75de-451f-88fe-beb7bf875ab9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.004637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.005314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.005606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.006391 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.006600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.009747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.011807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a1e5220e054a5ba8cac53f901cfed9)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.013871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.072377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 867/1744] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:08 2022] POST /identity/v3/projects => generated 393 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:09.076339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.115017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a1e5220e054a5ba8cac53f901cfed9', 'request_id': 'req-d6cce5e5-8ea2-4613-b088-4d594791d400'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.133462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a1e5220e054a5ba8cac53f901cfed9', 'request_id': 'req-d6cce5e5-8ea2-4613-b088-4d594791d400'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.149054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a1e5220e054a5ba8cac53f901cfed9', 'request_id': 'req-d6cce5e5-8ea2-4613-b088-4d594791d400'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.176275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] The token cache is being invalidate because project 97a1e5220e054a5ba8cac53f901cfed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:09.176727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.177781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d6cce5e5-8ea2-4613-b088-4d594791d400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.191612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 878/1745] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:08 2022] DELETE /identity/v3/projects/97a1e5220e054a5ba8cac53f901cfed9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:09.193398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.193890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.195269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.237193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] MFA Rules not processed for user `26b0eae6a587416e85623bf2c82a51f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:09.238572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:09.245942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3bc77-7aa5-4e98-8913-b2de024308d6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.337115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 879/1746] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:09.338268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.339928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:09.424149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.424291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6d7e6-fae6-4ead-bd4d-e0d8aab86245 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.424855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.425284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.425631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.426492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.428560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.429232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.430110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.430398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.430683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] PATH_INFO: `/v3/users/47cda606838c4650bb5c64a07b31dbab` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.432219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cda606838c4650bb5c64a07b31dbab)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.434558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.479812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 868/1747] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:09 2022] POST /identity/v3/users => generated 303 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:09.481539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.484819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:09.513192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8a226-9cd0-4db9-a363-35d87e5fce38 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.525722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.526814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.527251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.527541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.528330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.533038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.556481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cda606838c4650bb5c64a07b31dbab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.557673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cda606838c4650bb5c64a07b31dbab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.577826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cda606838c4650bb5c64a07b31dbab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.594792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cda606838c4650bb5c64a07b31dbab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.596146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cda606838c4650bb5c64a07b31dbab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:09.601480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 869/1748] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:09 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:09.603916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.606739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:09.617593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 880/1749] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:09 2022] DELETE /identity/v3/users/47cda606838c4650bb5c64a07b31dbab => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:09.619202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.621935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:09.721844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca56cd-3dc8-4a1b-b03d-4e0314abfb27 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.726370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.727199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.727633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.728006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.728803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.731011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.794834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 881/1750] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:09 2022] POST /identity/v3/users => generated 309 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:09.799138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.800351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab857-759f-4141-a114-786291e4db2e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.826133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53393a3f-1cd4-4ba8-a7ad-9661467b25a5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.827119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.827970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.828265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.828663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.829356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.830976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.831095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.831746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.832029 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.832302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.833028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.834617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.857899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 882/1751] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:09.861818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.868307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 870/1752] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:09.872506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:09.885140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f902c-5b3f-47d6-9ba8-952792ea9dc7 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.909052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6eaef-913a-4c86-b0b5-4388a92dc624 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:09.909439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.910416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.910701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.910973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] PATH_INFO: `/v3/projects/0d4af3a3024a4d7281abf3c5e97e01c6/users/84fffd80432144d89658f7ff2a3e8d72/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.915825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:09.916820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:09.917130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:09.917567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] PATH_INFO: `/v3/projects/637e16279a11467a8c71bcf5c118b7f7/users/e6618b7a9baa49b2886601dc50902dbf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:09.955062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=637e16279a11467a8c71bcf5c118b7f7, user_id=e6618b7a9baa49b2886601dc50902dbf, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.958987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.971966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4af3a3024a4d7281abf3c5e97e01c6, user_id=84fffd80432144d89658f7ff2a3e8d72, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:09.974862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:09.996114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 883/1753] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:09 2022] PUT /identity/v3/projects/0d4af3a3024a4d7281abf3c5e97e01c6/users/84fffd80432144d89658f7ff2a3e8d72/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:09.999805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:10.007289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 871/1754] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:09 2022] PUT /identity/v3/projects/637e16279a11467a8c71bcf5c118b7f7/users/e6618b7a9baa49b2886601dc50902dbf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:10.012456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:10.170180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ee177-f406-492a-bd81-d08453ff7979 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:10.182763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:10.183488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.183812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.184095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.184837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:10.186628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:10.190657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30bade-407e-4fad-9cbb-c30483f04d9a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:10.209882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 884/1755] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:10.210078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:10.210078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.210078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.210078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.210412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:10.210947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:10.216040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:10.231455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae516e3b-0129-4378-9875-4ca12fd6a8f4 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:10.243229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 872/1756] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:10.246827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:10.253024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd783c-4223-4c32-87e6-6c5b9bf7b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:10.253834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd783c-4223-4c32-87e6-6c5b9bf7b2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.254114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd783c-4223-4c32-87e6-6c5b9bf7b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.254396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd783c-4223-4c32-87e6-6c5b9bf7b2a6 admin admin] PATH_INFO: `/v3/projects/0d4af3a3024a4d7281abf3c5e97e01c6/users/84fffd80432144d89658f7ff2a3e8d72/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.262080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd783c-4223-4c32-87e6-6c5b9bf7b2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4af3a3024a4d7281abf3c5e97e01c6, user_id=84fffd80432144d89658f7ff2a3e8d72, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:10.270577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd783c-4223-4c32-87e6-6c5b9bf7b2a6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:10.273193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3aefd-f454-4cce-b70d-ec99e02fcf1b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:10.282152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:10.284840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.285349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.286864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] PATH_INFO: `/v3/projects/637e16279a11467a8c71bcf5c118b7f7/users/e6618b7a9baa49b2886601dc50902dbf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.292224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637e16279a11467a8c71bcf5c118b7f7, user_id=e6618b7a9baa49b2886601dc50902dbf, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:10.297575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 885/1757] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:10 2022] PUT /identity/v3/projects/0d4af3a3024a4d7281abf3c5e97e01c6/users/84fffd80432144d89658f7ff2a3e8d72/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:10.298545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:10.326574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.326873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.327161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.328548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 873/1758] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:10 2022] PUT /identity/v3/projects/637e16279a11467a8c71bcf5c118b7f7/users/e6618b7a9baa49b2886601dc50902dbf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:10.378883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] MFA Rules not processed for user `e6618b7a9baa49b2886601dc50902dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:10.380207 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:10.543582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 886/1759] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:10.556755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:10.561041 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:10.673526 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239f99f-6a49-42ed-8575-527b4a4a34b3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:10.678613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:10.679454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.681012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.681342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.696570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:10.698264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:10.712855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 874/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:10.777148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:10.778998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:10.792386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03244cb9-1846-42d6-89c6-1e024fa152c2 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:10.797858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:10.798695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:10.799630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:10.799630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:10.801654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:10.881404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:10.882800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271db3f-e9fa-477c-bb20-1a32563d45f0 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:10.896886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 887/1761] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:11.194542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:11.196680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:11.405196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39724-5892-4d37-84a8-1c1e78becb3a service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:11.428787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:11.431486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:11.431803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:11.432091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] PATH_INFO: `/v3/projects/8b3f12e259e04bd4a19aacb02f216e59` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:11.436778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3f12e259e04bd4a19aacb02f216e59)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:11.440128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:11.586807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3f12e259e04bd4a19aacb02f216e59', 'request_id': 'req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:11.596217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3f12e259e04bd4a19aacb02f216e59', 'request_id': 'req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:11.603198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3f12e259e04bd4a19aacb02f216e59', 'request_id': 'req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:11.615998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] The token cache is being invalidate because project 8b3f12e259e04bd4a19aacb02f216e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:11.616307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:11.616969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82d57519-4f43-48d1-ac1d-71c6aaa0dd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:11.618556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 875/1762] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:11 2022] DELETE /identity/v3/projects/8b3f12e259e04bd4a19aacb02f216e59 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:11.624934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:11.625413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:11.625667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:11.670715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:11.679729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:11.781047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 888/1763] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:11.790644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:11.790964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:11.791248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:11.813083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:11.814650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:11.823334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 876/1764] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:11.828201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:11.838967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e1b3-1257-4fcc-a879-fabed67a4d4c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:11.844458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:11.845235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:11.845593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:11.845944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:11.846892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:11.847544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:11.849006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:11.861957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 889/1765] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:11.866354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:11.889226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dac28-c904-4a12-b963-3f943f35997f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:11.893079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:11.893804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:11.894137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:11.894397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:11.895206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:11.897795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:11.936936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 877/1766] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:11 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:11.941279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:11.952411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b89c-0f8f-4a91-85f7-8af906eac434 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:12.014637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:12.015344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.015835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.016175 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.017440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:12.019063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:12.047359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 890/1767] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:11 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:12.051261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:12.066646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfda495-257a-4af6-989c-222aa6326a06 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:12.073605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32243ad-c6d7-46e1-af74-9faaf1f118fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:12.074848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32243ad-c6d7-46e1-af74-9faaf1f118fa admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.075134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32243ad-c6d7-46e1-af74-9faaf1f118fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.075409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32243ad-c6d7-46e1-af74-9faaf1f118fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.076177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32243ad-c6d7-46e1-af74-9faaf1f118fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:12.077821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32243ad-c6d7-46e1-af74-9faaf1f118fa admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:12.099569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 878/1768] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:12.101986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:12.119897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.122818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223de2f-a6e1-49d5-a656-eafa15742b74 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:12.123313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.123721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.147283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:12.148141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.148448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.148815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.149630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:12.151393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:12.170740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 891/1769] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:12.172573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:12.184277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] MFA Rules not processed for user `84fffd80432144d89658f7ff2a3e8d72`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:12.185030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1c92d-089e-4103-b54e-6a1a0aab7a1b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:12.186496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:12.190498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391395a-bba0-40d1-a7b2-2a84bd067971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:12.191503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391395a-bba0-40d1-a7b2-2a84bd067971 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.191905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391395a-bba0-40d1-a7b2-2a84bd067971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.192256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391395a-bba0-40d1-a7b2-2a84bd067971 admin admin] PATH_INFO: `/v3/projects/db15df71a04b46948d5b33d464991c07/users/1f353c5d1e044b57b73b82ac79dd0122/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.219622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391395a-bba0-40d1-a7b2-2a84bd067971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db15df71a04b46948d5b33d464991c07, user_id=1f353c5d1e044b57b73b82ac79dd0122, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:12.223115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391395a-bba0-40d1-a7b2-2a84bd067971 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:12.268086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 892/1770] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:12 2022] PUT /identity/v3/projects/db15df71a04b46948d5b33d464991c07/users/1f353c5d1e044b57b73b82ac79dd0122/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:12.270680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.273454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.273949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.336789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] MFA Rules not processed for user `1f353c5d1e044b57b73b82ac79dd0122`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:12.337442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 879/1771] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:12.338768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:12.499816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 893/1772] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:12.504485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:12.521018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcafcc-ff8c-4c11-bc25-707857396406 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:12.676257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:12.680378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.681218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.681609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.683225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:12.688329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:12.750080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 880/1773] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:12 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:12.750391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:12.762519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4397f-ae00-4966-a55b-4a107ac046ee None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:12.928044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:12.928796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:12.929104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:12.929354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:12.934661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:12.939644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:12.991390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 894/1774] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:12 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:12.996192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:13.017725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d6f61-362c-424e-8157-cf96387f47ff admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:13.036578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:13.037267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:13.037550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:13.037831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:13.038572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:13.040233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:13.064685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:13.071209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 881/1775] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:13.080623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562f27b-696a-4aa5-99d6-213e15d5612d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:13.094449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:13.096627 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:13.098511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:13.098955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] PATH_INFO: `/v3/projects/ae15db8be3004bada8ed3624a4b19c7f/users/3fa05c061b444bd6a09b512c89a78f12/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:13.122746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae15db8be3004bada8ed3624a4b19c7f, user_id=3fa05c061b444bd6a09b512c89a78f12, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:13.126592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:13.146889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 895/1776] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:13 2022] PUT /identity/v3/projects/ae15db8be3004bada8ed3624a4b19c7f/users/3fa05c061b444bd6a09b512c89a78f12/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:13.152880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:13.176477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b3b7-df68-498f-8ce4-9eceeb1f36ee admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:13.304681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ce3f6-bf62-4081-9566-a0ea6bd6aa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:13.305855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce3f6-bf62-4081-9566-a0ea6bd6aa58 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:13.306250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce3f6-bf62-4081-9566-a0ea6bd6aa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:13.306637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ce3f6-bf62-4081-9566-a0ea6bd6aa58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:13.307494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ce3f6-bf62-4081-9566-a0ea6bd6aa58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:13.314856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ce3f6-bf62-4081-9566-a0ea6bd6aa58 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:13.342691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:13.354494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d478c5-f1d3-4f4d-abe3-645bb4b6a92c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:13.355092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 882/1777] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:13.370083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:13.385203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:13.388788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:13.389388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] PATH_INFO: `/v3/projects/ae15db8be3004bada8ed3624a4b19c7f/users/3fa05c061b444bd6a09b512c89a78f12/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:13.394155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae15db8be3004bada8ed3624a4b19c7f, user_id=3fa05c061b444bd6a09b512c89a78f12, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:13.399605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:13.426075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 896/1778] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:13 2022] PUT /identity/v3/projects/ae15db8be3004bada8ed3624a4b19c7f/users/3fa05c061b444bd6a09b512c89a78f12/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:13.441596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:13.441893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:13.442176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:13.503753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] MFA Rules not processed for user `3fa05c061b444bd6a09b512c89a78f12`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:13.505104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:13.689482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 883/1779] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:13.739659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:13.743174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:13.904511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284c388-cf8a-42e8-a4eb-6386b05b1557 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:13.910251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:13.911330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:13.911846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:13.912324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:13.924832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:13.926574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:13.938065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 897/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:14.064742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:14.066188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:14.084006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8ae3b-9b52-4e26-8965-3e6688cde6fc None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:14.090384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:14.092192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:14.092722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:14.093008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:14.193057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:14.196508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:14.224545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 884/1781] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:14.799043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:14.801409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:14.888237 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:14.890482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:14.957410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af29f8e-579a-425e-9ee3-742f5479f85f service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:14.966398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:14.967554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:14.967848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:14.968127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] PATH_INFO: `/v3/users/26b0eae6a587416e85623bf2c82a51f6` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:14.969383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b0eae6a587416e85623bf2c82a51f6)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:14.971450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:15.028165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e9e1f-4273-4588-974c-c10f1a7f9d1b service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:15.039477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:15.041340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:15.041747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:15.042173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] PATH_INFO: `/v3/users/1dde04c23f524fc4b956eceb24475eb3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:15.044333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dde04c23f524fc4b956eceb24475eb3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:15.046324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:15.053124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b0eae6a587416e85623bf2c82a51f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.053884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b0eae6a587416e85623bf2c82a51f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.079767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b0eae6a587416e85623bf2c82a51f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.093349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b0eae6a587416e85623bf2c82a51f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.095939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cae9bc1f-866b-4ca4-95a3-8fc5f56aee3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b0eae6a587416e85623bf2c82a51f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.118821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 898/1782] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:14 2022] DELETE /identity/v3/users/26b0eae6a587416e85623bf2c82a51f6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:15.122481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dde04c23f524fc4b956eceb24475eb3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.133050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dde04c23f524fc4b956eceb24475eb3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.155352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dde04c23f524fc4b956eceb24475eb3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.157143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dde04c23f524fc4b956eceb24475eb3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.166325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dde04c23f524fc4b956eceb24475eb3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.174656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 885/1783] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:14 2022] DELETE /identity/v3/users/1dde04c23f524fc4b956eceb24475eb3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:15.179061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:15.179354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:15.179661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:15.204251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:15.205512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:15.299573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 899/1784] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:15.338607 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:15.341238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:15.418256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7266b9-0923-4d3b-ba2f-4522da1f8823 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:15.422540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:15.423390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:15.423979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:15.424393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:15.436093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:15.438884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:15.453131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 886/1785] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:15.482565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:15.484227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:15.505801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11730e9e-295c-4d16-afab-6504441a2d46 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:15.513505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:15.514791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:15.515451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:15.515451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] PATH_INFO: `/v3/projects/7c9ee0a897ee4e15a1d688b890d02df9` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:15.516727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9ee0a897ee4e15a1d688b890d02df9)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:15.519013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:15.645162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9ee0a897ee4e15a1d688b890d02df9', 'request_id': 'req-014a4eb8-99d2-4389-99bd-30740130c848'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.672079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9ee0a897ee4e15a1d688b890d02df9', 'request_id': 'req-014a4eb8-99d2-4389-99bd-30740130c848'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.685097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9ee0a897ee4e15a1d688b890d02df9', 'request_id': 'req-014a4eb8-99d2-4389-99bd-30740130c848'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.718678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] The token cache is being invalidate because project 7c9ee0a897ee4e15a1d688b890d02df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:15.718678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.720087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:15.727708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 900/1786] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:15 2022] DELETE /identity/v3/projects/7c9ee0a897ee4e15a1d688b890d02df9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:15.732100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:15.755788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd00b8-5f73-4096-a6e6-8a1cfa33cae8 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:15.926829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:15.928837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:15.929321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:15.929772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] PATH_INFO: `/v3/users/84fffd80432144d89658f7ff2a3e8d72` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:15.931569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fffd80432144d89658f7ff2a3e8d72)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:15.946943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.023683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fffd80432144d89658f7ff2a3e8d72'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.037108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fffd80432144d89658f7ff2a3e8d72'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.053894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fffd80432144d89658f7ff2a3e8d72'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.054665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fffd80432144d89658f7ff2a3e8d72'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.062480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fffd80432144d89658f7ff2a3e8d72'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.068463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 887/1787] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:15 2022] DELETE /identity/v3/users/84fffd80432144d89658f7ff2a3e8d72 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:16.079147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.080824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:16.101677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a4eb8-99d2-4389-99bd-30740130c848 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.215242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.216562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.216996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.217474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] PATH_INFO: `/v3/projects/5e1f95fe3aae4ca4b43f7b46e5cf9e9e` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.219912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1f95fe3aae4ca4b43f7b46e5cf9e9e)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.223290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.294290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1f95fe3aae4ca4b43f7b46e5cf9e9e', 'request_id': 'req-d1348455-3198-4ca7-873b-64f00d0d1b46'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.300930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1f95fe3aae4ca4b43f7b46e5cf9e9e', 'request_id': 'req-d1348455-3198-4ca7-873b-64f00d0d1b46'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.310217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1f95fe3aae4ca4b43f7b46e5cf9e9e', 'request_id': 'req-d1348455-3198-4ca7-873b-64f00d0d1b46'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.321938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.323767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:16.339798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] The token cache is being invalidate because project 5e1f95fe3aae4ca4b43f7b46e5cf9e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:16.340208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.340924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.343970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbf855-c9a8-4dc9-9dbf-276e724bf28b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.346129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 901/1788] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:16 2022] DELETE /identity/v3/projects/5e1f95fe3aae4ca4b43f7b46e5cf9e9e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:16.347285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.348911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:16.437989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.439072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.439427 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.439943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] PATH_INFO: `/v3/projects/0d4af3a3024a4d7281abf3c5e97e01c6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.441365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4af3a3024a4d7281abf3c5e97e01c6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.443363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.443493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1348455-3198-4ca7-873b-64f00d0d1b46 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.450323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.451465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.451859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.452310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] PATH_INFO: `/v3/users/e6618b7a9baa49b2886601dc50902dbf` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.453634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6618b7a9baa49b2886601dc50902dbf)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.455866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.496698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4af3a3024a4d7281abf3c5e97e01c6', 'request_id': 'req-64b67c14-e4fc-44f6-8f20-c7d5a7477159'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.505999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4af3a3024a4d7281abf3c5e97e01c6', 'request_id': 'req-64b67c14-e4fc-44f6-8f20-c7d5a7477159'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.512849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4af3a3024a4d7281abf3c5e97e01c6', 'request_id': 'req-64b67c14-e4fc-44f6-8f20-c7d5a7477159'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.524729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] The token cache is being invalidate because project 0d4af3a3024a4d7281abf3c5e97e01c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:16.525166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.526403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-64b67c14-e4fc-44f6-8f20-c7d5a7477159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.528556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6618b7a9baa49b2886601dc50902dbf'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.529860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6618b7a9baa49b2886601dc50902dbf'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.532577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 888/1789] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:16 2022] DELETE /identity/v3/projects/0d4af3a3024a4d7281abf3c5e97e01c6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:16.534338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.534628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.534909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.554784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6618b7a9baa49b2886601dc50902dbf'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.556841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:16.558590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:16.568044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6618b7a9baa49b2886601dc50902dbf'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.569002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9cbf703c-3aa1-42d9-9b3e-270d48962d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6618b7a9baa49b2886601dc50902dbf'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:16.586828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 902/1790] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:16 2022] DELETE /identity/v3/users/e6618b7a9baa49b2886601dc50902dbf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:16.623916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 889/1791] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:16.633278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.633567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.633862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.661093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:16.664670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:16.730227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 903/1792] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:16.734698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.757236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32958bf-ecb9-4b7a-8ab9-e544f1c5f53e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.763765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.764485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.765360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.765641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.766376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:16.767156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.769049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.782034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 890/1793] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:16.786436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.795597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b26519-66c8-41f4-914a-0e98bd07b240 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.800284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.800949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.801234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.801515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.802225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.804178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.830273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 904/1794] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:16 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:16.834247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.844482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ec04-476e-48c9-a983-4274981eb01f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.868779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.870648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:16.910168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.910844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.911130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.911410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.912153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.914077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.933604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 891/1795] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:16 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:16.937522 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.939843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd4a16-47c4-460f-b569-b21fde7ea31b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.945336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.946203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.946484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.946723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ad82-428f-4887-8ca5-018e582ead3c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.946843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] PATH_INFO: `/v3/projects/637e16279a11467a8c71bcf5c118b7f7` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.947947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=637e16279a11467a8c71bcf5c118b7f7)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.950401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.952356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:16.953033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:16.955985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:16.956270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:16.957011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:16.958636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:16.969504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 892/1796] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:16.972598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:16.983448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46c929-51a4-4d80-98b5-d70eeac1ce07 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:16.999038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637e16279a11467a8c71bcf5c118b7f7', 'request_id': 'req-4dd0c70f-dbad-49ce-99c3-f2552e295948'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:17.006742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637e16279a11467a8c71bcf5c118b7f7', 'request_id': 'req-4dd0c70f-dbad-49ce-99c3-f2552e295948'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:17.014351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637e16279a11467a8c71bcf5c118b7f7', 'request_id': 'req-4dd0c70f-dbad-49ce-99c3-f2552e295948'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:17.027551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] The token cache is being invalidate because project 637e16279a11467a8c71bcf5c118b7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:17.027864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:17.032404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4dd0c70f-dbad-49ce-99c3-f2552e295948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:17.035555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 905/1797] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:16 2022] DELETE /identity/v3/projects/637e16279a11467a8c71bcf5c118b7f7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:17.039851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dd134-be61-4e06-b8fa-e1171b22917b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.040147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dd134-be61-4e06-b8fa-e1171b22917b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.040430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dd134-be61-4e06-b8fa-e1171b22917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.066439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-aa1dd134-be61-4e06-b8fa-e1171b22917b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:17.068615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-aa1dd134-be61-4e06-b8fa-e1171b22917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:17.073174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.073955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.074309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.074714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.075798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.077970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.083708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 906/1798] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:17.089883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.090252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.091840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 893/1799] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:17.095796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.095940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.097675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:17.111772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52b51f-65fe-48ac-9564-0a5261deff56 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.123145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.123707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:17.124303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.124751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.125202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:17.125818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] PATH_INFO: `/v3/projects/2e90a46820ed47ee9e77688c016fe238/users/49939e8572a248fe9474fa5ca1c9b490/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.135492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 907/1800] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:17.139609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.154495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e90a46820ed47ee9e77688c016fe238, user_id=49939e8572a248fe9474fa5ca1c9b490, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.155137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0c2b7-f39d-4207-9488-068d43059e55 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.158203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.160002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.160980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.161448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.161738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.162531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:17.163232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.165115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799a12-efc0-4e45-bde4-9d684dc11fe1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.180696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 894/1801] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:17 2022] PUT /identity/v3/projects/2e90a46820ed47ee9e77688c016fe238/users/49939e8572a248fe9474fa5ca1c9b490/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:17.184654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 908/1802] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:58:17.188930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.191233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.191913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.192397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.224981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] MFA Rules not processed for user `49939e8572a248fe9474fa5ca1c9b490`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:17.226263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:17.257367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385d1e0-b162-4122-b00a-29b75f4a26d0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.262565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.263297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.263705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.264051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.264813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.266881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.298375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 895/1803] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:17.302803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 909/1804] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:17.304377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.310045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.321386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617e21e-8ad0-4173-ac61-c9e2914399a8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.396062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11779f45-d08a-473c-947d-740fd9954267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.397090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779f45-d08a-473c-947d-740fd9954267 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.397554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779f45-d08a-473c-947d-740fd9954267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.398103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779f45-d08a-473c-947d-740fd9954267 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.398940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779f45-d08a-473c-947d-740fd9954267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.401359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779f45-d08a-473c-947d-740fd9954267 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.413599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624689ed-755c-415b-aea3-c96f872de2b1 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.433447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.434218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.434490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.434805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.435683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.440011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.460329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 910/1805] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:17.466296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659acd37-d2c9-42a2-9798-728461a77fc2 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.467772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659acd37-d2c9-42a2-9798-728461a77fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.468516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659acd37-d2c9-42a2-9798-728461a77fc2 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.471122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 911/1806] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 15:58:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 15:58:17.472074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659acd37-d2c9-42a2-9798-728461a77fc2 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.480228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 896/1807] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:17.485076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.496270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19effc5-b851-441d-bc13-f487a5acad71 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.561106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659acd37-d2c9-42a2-9798-728461a77fc2 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.566171 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1a87e-36a3-431f-b664-b19ac2ca2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.566828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a87e-36a3-431f-b664-b19ac2ca2ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.567108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a87e-36a3-431f-b664-b19ac2ca2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.567383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1a87e-36a3-431f-b664-b19ac2ca2ff4 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.568132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1a87e-36a3-431f-b664-b19ac2ca2ff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.570563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1a87e-36a3-431f-b664-b19ac2ca2ff4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.593938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 912/1808] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:17.595205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.595779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.596070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.608207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.608899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.609188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.610040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.610787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.612435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.621563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:17.622976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:17.634566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 897/1809] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:17.635700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.659914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae932e8b-9f34-4959-868c-060284ed5c99 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.668265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.668941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.669238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.669524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.672802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.674472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.700781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 898/1810] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:17.701981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.723745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62595184-ac39-4be4-be61-ca57613d6a9e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.736309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.737009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.737750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.737750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.738282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.749680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.754746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 913/1811] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:17.755923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.774471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 899/1812] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:17.774668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977383-d002-466a-afc2-5777af89ed92 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.775517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.783206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.784829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.786420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.786912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] PATH_INFO: `/v3/projects/0718cc73e7a34399a3172e4750047480/users/3f352eb8ac254170bd4eabe58b614e51/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.790494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b5f0-ac7c-4f4b-ba72-23a741fda0cf admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.800486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.800777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.801002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.803716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] PATH_INFO: `/v3/projects/19698df25fcc4de0ac33c1eb715b7702/users/0e9fa16cdcea41f98a2e6f26ef6a2e67/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.807481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0718cc73e7a34399a3172e4750047480, user_id=3f352eb8ac254170bd4eabe58b614e51, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.812138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.828519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19698df25fcc4de0ac33c1eb715b7702, user_id=0e9fa16cdcea41f98a2e6f26ef6a2e67, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:17.829141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 914/1813] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:17 2022] PUT /identity/v3/projects/0718cc73e7a34399a3172e4750047480/users/3f352eb8ac254170bd4eabe58b614e51/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:17.833669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.843741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:17.880210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 900/1814] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:17 2022] PUT /identity/v3/projects/19698df25fcc4de0ac33c1eb715b7702/users/0e9fa16cdcea41f98a2e6f26ef6a2e67/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:17.881348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:17.883190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:17.936056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8036-887b-4eec-bed6-512c6ac60e04 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.990627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c71067-6a5e-4fcf-9d8e-262027732167 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:17.996976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.997661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:17.997978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:17.998261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:17.998938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82f479-04a4-4fe1-9b3b-83074b25d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:17.999800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82f479-04a4-4fe1-9b3b-83074b25d787 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.000234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82f479-04a4-4fe1-9b3b-83074b25d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.000662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82f479-04a4-4fe1-9b3b-83074b25d787 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.001404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82f479-04a4-4fe1-9b3b-83074b25d787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.003079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82f479-04a4-4fe1-9b3b-83074b25d787 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.007155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.008772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.015779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 915/1815] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:18.017507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.018167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.018795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.021464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 901/1816] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:18.022312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.032785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9a22e-7fdd-405b-baca-23de4e359be0 service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.037985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924d8c2-c3a3-4bb7-876c-8977d1963737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.038982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924d8c2-c3a3-4bb7-876c-8977d1963737 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.039265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924d8c2-c3a3-4bb7-876c-8977d1963737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.039561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924d8c2-c3a3-4bb7-876c-8977d1963737 admin admin] PATH_INFO: `/v3/projects/0718cc73e7a34399a3172e4750047480/users/3f352eb8ac254170bd4eabe58b614e51/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.041520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924d8c2-c3a3-4bb7-876c-8977d1963737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0718cc73e7a34399a3172e4750047480, user_id=3f352eb8ac254170bd4eabe58b614e51, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.044202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924d8c2-c3a3-4bb7-876c-8977d1963737 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.067224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 902/1817] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:18 2022] PUT /identity/v3/projects/0718cc73e7a34399a3172e4750047480/users/3f352eb8ac254170bd4eabe58b614e51/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:18.072251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] MFA Rules not processed for user `0e9fa16cdcea41f98a2e6f26ef6a2e67`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:18.073729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.080833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.081251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.081636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.112991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] MFA Rules not processed for user `3f352eb8ac254170bd4eabe58b614e51`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:18.114324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.155893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 916/1818] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:18.164687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.166757 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.207501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 903/1819] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:18.227446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.229124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.234363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea705f9-8947-41e2-be70-a8dd12b69db3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.238141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.238948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.239232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.239519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.242153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21908e25-14ef-4481-98f1-4642fcd471c4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.246055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.246716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.247005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.247283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.251133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.252820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.256635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.258060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.262771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 917/1820] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:18.269443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 904/1821] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:18.285641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.352673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.366335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdae15-0479-4c18-830f-6129bb8be6f2 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.374773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.375440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.375753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.376031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.426891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca32ba-7ef2-473a-a446-bd699a8947d1 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.443703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.444703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.445166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.446633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] PATH_INFO: `/v3/users/0e9fa16cdcea41f98a2e6f26ef6a2e67` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.449091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9fa16cdcea41f98a2e6f26ef6a2e67)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.454263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.501467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.502958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.539282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 905/1822] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:18.540208 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.547442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.548280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9fa16cdcea41f98a2e6f26ef6a2e67'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.549457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9fa16cdcea41f98a2e6f26ef6a2e67'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.564376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9fa16cdcea41f98a2e6f26ef6a2e67'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.567357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a070bf6-d9dd-4d3f-bd7d-4632d6981fc5 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.573510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.574629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9fa16cdcea41f98a2e6f26ef6a2e67'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.575139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.575375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aecf1f2c-37ad-4faa-892e-630a90b8f660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9fa16cdcea41f98a2e6f26ef6a2e67'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.575985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.576484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] PATH_INFO: `/v3/users/1f353c5d1e044b57b73b82ac79dd0122` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.578053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f353c5d1e044b57b73b82ac79dd0122)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.580285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.593510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 918/1823] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:18 2022] DELETE /identity/v3/users/0e9fa16cdcea41f98a2e6f26ef6a2e67 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:18.594966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb19e-847c-441e-9714-762f01f6178c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.595260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb19e-847c-441e-9714-762f01f6178c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.595569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eb19e-847c-441e-9714-762f01f6178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.614573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-000eb19e-847c-441e-9714-762f01f6178c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:18.616131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-000eb19e-847c-441e-9714-762f01f6178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.658515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f353c5d1e044b57b73b82ac79dd0122'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.672387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f353c5d1e044b57b73b82ac79dd0122'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.689679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f353c5d1e044b57b73b82ac79dd0122'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.691111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f353c5d1e044b57b73b82ac79dd0122'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.703386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f353c5d1e044b57b73b82ac79dd0122'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:18.710759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 919/1824] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:18.718027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 906/1825] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:18 2022] DELETE /identity/v3/users/1f353c5d1e044b57b73b82ac79dd0122 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:18.751715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.752327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.753381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.799281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:18.800532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.820016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.824111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.898085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 920/1826] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:18.913983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:18.915686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:18.939655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0537cfa-f54e-4966-b05f-0edbf42cc586 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.943785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.944478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.944815 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.945235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:18.956626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:18.958181 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:18.971004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 907/1827] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:18.994269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf488e9-8d8e-414e-9e57-35b3e40aa89b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:18.998492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:18.999779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:18.999779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:18.999952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.010395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:19.012712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:19.031111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 921/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:19.479209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:19.480797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:19.494341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204216f-10b9-4e93-bde2-0d1a2d6b4cf6 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:19.501096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:19.502165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.502721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.503301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] PATH_INFO: `/v3/projects/db15df71a04b46948d5b33d464991c07` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.505472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db15df71a04b46948d5b33d464991c07)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:19.508178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:19.569450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db15df71a04b46948d5b33d464991c07', 'request_id': 'req-ef37b5bb-747c-4aba-8029-e8d3ca8de093'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.580192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db15df71a04b46948d5b33d464991c07', 'request_id': 'req-ef37b5bb-747c-4aba-8029-e8d3ca8de093'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.589939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db15df71a04b46948d5b33d464991c07', 'request_id': 'req-ef37b5bb-747c-4aba-8029-e8d3ca8de093'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.605182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] The token cache is being invalidate because project db15df71a04b46948d5b33d464991c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:19.605481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.606156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.608158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 908/1829] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:19 2022] DELETE /identity/v3/projects/db15df71a04b46948d5b33d464991c07 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:19.612136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:19.612825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:19.613583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:19.614394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:19.629629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6f4c9-8262-45b2-b5db-ccdd5a1a5032 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:19.695714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37b5bb-747c-4aba-8029-e8d3ca8de093 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:19.700394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:19.700534 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:19.701325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.701444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.701599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.701837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.701923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] PATH_INFO: `/v3/users/3fa05c061b444bd6a09b512c89a78f12` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.702220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] PATH_INFO: `/v3/projects/19698df25fcc4de0ac33c1eb715b7702` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.703050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa05c061b444bd6a09b512c89a78f12)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:19.703550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19698df25fcc4de0ac33c1eb715b7702)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:19.705010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:19.705667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:19.750968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19698df25fcc4de0ac33c1eb715b7702', 'request_id': 'req-5bfb8262-d0ff-4323-bf2f-34948caae3b1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.757109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19698df25fcc4de0ac33c1eb715b7702', 'request_id': 'req-5bfb8262-d0ff-4323-bf2f-34948caae3b1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.757789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa05c061b444bd6a09b512c89a78f12'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.766108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa05c061b444bd6a09b512c89a78f12'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.768992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19698df25fcc4de0ac33c1eb715b7702', 'request_id': 'req-5bfb8262-d0ff-4323-bf2f-34948caae3b1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.778802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa05c061b444bd6a09b512c89a78f12'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.779724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa05c061b444bd6a09b512c89a78f12'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.780871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] The token cache is being invalidate because project 19698df25fcc4de0ac33c1eb715b7702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:19.781231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.781839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5bfb8262-d0ff-4323-bf2f-34948caae3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.784137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 922/1830] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:19 2022] DELETE /identity/v3/projects/19698df25fcc4de0ac33c1eb715b7702 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:19.790135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.790135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.790321 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.794286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-07d128df-ec03-47d9-ae40-3be57a8aa7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa05c061b444bd6a09b512c89a78f12'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:19.802830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 909/1831] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:19 2022] DELETE /identity/v3/users/3fa05c061b444bd6a09b512c89a78f12 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:19.815972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:19.817169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:19.895820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 923/1832] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:19.899605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.899906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.900185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.918832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:19.920077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:19.928999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 910/1833] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:19.935638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:19.945447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4e9d2-25f2-4c59-83ef-891ace95e476 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:19.950777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:19.951437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.951995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.952194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.952880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:19.953187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:19.956555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:19.973292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 924/1834] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:19.977379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:19.987281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bbb86-9b2c-4454-bf1b-901109b2ccf8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:19.994578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:19.995459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:19.995723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:19.996004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:19.996753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:19.998682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.031158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 911/1835] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:19 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:20.040025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.050758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434f0d-1b7b-42e6-bb97-bbb2ba3abec2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.140126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.140687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.140969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.141244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.141953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.143895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.152242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.155100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:20.182013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 925/1836] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/users => generated 282 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:20.183390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.187381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848aa01-6d71-4157-8a5e-91e5f6038d84 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.200319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.201378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.201667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.201950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] PATH_INFO: `/v3/projects/ae15db8be3004bada8ed3624a4b19c7f` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.203166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae15db8be3004bada8ed3624a4b19c7f)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.206701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d562ba-4735-4afd-b0b7-bb2d25a6d400 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.209301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.212328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.212987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.213260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.213535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.215182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.216619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.229952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 926/1837] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:20.230982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.249705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f44c8-0db6-42dd-94ca-c71a73ee4606 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.258645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.259318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.259635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.259913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.260662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.262973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.271561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae15db8be3004bada8ed3624a4b19c7f', 'request_id': 'req-574c3129-5c03-4507-a606-429d44af99de'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:20.274007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 927/1838] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:20.278809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.282226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae15db8be3004bada8ed3624a4b19c7f', 'request_id': 'req-574c3129-5c03-4507-a606-429d44af99de'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:20.288971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c89f6d-c9cb-4a8e-8348-eefd3919463f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.289106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae15db8be3004bada8ed3624a4b19c7f', 'request_id': 'req-574c3129-5c03-4507-a606-429d44af99de'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:20.301645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] The token cache is being invalidate because project ae15db8be3004bada8ed3624a4b19c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:20.301854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:20.302769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-574c3129-5c03-4507-a606-429d44af99de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:20.304668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 912/1839] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:20 2022] DELETE /identity/v3/projects/ae15db8be3004bada8ed3624a4b19c7f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:20.313891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400350c-be7f-432e-82c1-668cc4aab414 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.314262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400350c-be7f-432e-82c1-668cc4aab414 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.314655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400350c-be7f-432e-82c1-668cc4aab414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.336092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9400350c-be7f-432e-82c1-668cc4aab414 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:20.337357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9400350c-be7f-432e-82c1-668cc4aab414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:20.354190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f754aae-ccc6-485a-a939-6b29b454cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.355135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f754aae-ccc6-485a-a939-6b29b454cb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.355423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f754aae-ccc6-485a-a939-6b29b454cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.355733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f754aae-ccc6-485a-a939-6b29b454cb15 admin admin] PATH_INFO: `/v3/projects/978bdb97dca745229c91529235d8476c/users/fb2fdc46e2dd48e3b338f5fb012ebea6/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.370631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f754aae-ccc6-485a-a939-6b29b454cb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978bdb97dca745229c91529235d8476c, user_id=fb2fdc46e2dd48e3b338f5fb012ebea6, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.373338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f754aae-ccc6-485a-a939-6b29b454cb15 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.386541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 928/1840] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:20 2022] PUT /identity/v3/projects/978bdb97dca745229c91529235d8476c/users/fb2fdc46e2dd48e3b338f5fb012ebea6/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:20.397131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.397432 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.397701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.403730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 913/1841] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:20.409252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.409615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.409895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.425688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] MFA Rules not processed for user `fb2fdc46e2dd48e3b338f5fb012ebea6`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:20.427038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:20.438554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:20.439874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:20.518079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 914/1842] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:20.522593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.529456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 929/1843] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:20.534233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aea698-52e3-4b01-a47a-4d3212efe3f2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.538213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.539940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:20.541278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.542744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.543125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.543511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.544364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:20.544775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.546606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.564704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 915/1844] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:58:20.565809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.577644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfaef9-1b01-41c5-a276-ce271621a549 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.583543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.584317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.584713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.585095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.585890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.587950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.608313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab6f09-8a97-456a-8f66-60caa8078629 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.618148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 916/1845] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:20.619230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.620110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.620873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.621156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.622746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.629905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.631352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.639998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 930/1846] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:20.681560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146927b-2883-4a26-937a-992d3bbd474b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.686860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.687647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.688004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.688283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.689034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.691027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.712724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 917/1847] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:20.717090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.730951 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532a54b-9c70-4ed5-97a9-765ef4c1f180 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.735998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.736759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.737137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.737479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.738279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.740017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.754921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 931/1848] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:20.761033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.771425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc818-b5e9-4a37-adcd-5ddb8ba18f8f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.778333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e85f13-c6d9-41e1-bce1-9df236fc7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.779113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e85f13-c6d9-41e1-bce1-9df236fc7e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.779405 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e85f13-c6d9-41e1-bce1-9df236fc7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.779802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e85f13-c6d9-41e1-bce1-9df236fc7e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.780541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e85f13-c6d9-41e1-bce1-9df236fc7e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.782404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e85f13-c6d9-41e1-bce1-9df236fc7e69 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.794642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 918/1849] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:20.798681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:20.816603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdee16c-ab28-48d1-b1d3-58bbebe8fc5b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:20.822011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:20.822946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.823360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.823672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] PATH_INFO: `/v3/projects/29f01611b2524fcebdd12e99ec11045c/users/cb095a370c074b43837216a08cc1bac5/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.850031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f01611b2524fcebdd12e99ec11045c, user_id=cb095a370c074b43837216a08cc1bac5, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:20.853657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:20.869110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 932/1850] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:20 2022] PUT /identity/v3/projects/29f01611b2524fcebdd12e99ec11045c/users/cb095a370c074b43837216a08cc1bac5/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:20.879852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:20.880158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:20.880459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:20.908811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] MFA Rules not processed for user `cb095a370c074b43837216a08cc1bac5`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:20.910122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:20.978026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 919/1851] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:20.983452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.050895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203be528-8af3-402e-bc55-dc7c690e952a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.055780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.056441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.056727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.057005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.058177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.060330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.084616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 933/1852] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:20 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:21.088645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.099102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc0b6-a5d6-437b-b5bb-01668eed5f12 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.158836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.159502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.159813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.160116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.160814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.162760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.181707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 920/1853] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:21 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:21.186778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.197442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d1935-06c3-41aa-9d25-ee3c55c7682b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.202549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.203208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.203494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.203803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.204524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.206121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.217177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 934/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:21.221525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.231412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7e206-6c0e-499c-b713-88e3ee4d66b6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.236089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.236965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.237251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.237528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] PATH_INFO: `/v3/projects/7ceb77dfbb484d0ab95ca0a43490a7fb/users/05699bd75d8b4824b3fd35041190964e/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.251813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ceb77dfbb484d0ab95ca0a43490a7fb, user_id=05699bd75d8b4824b3fd35041190964e, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.254572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.267826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 921/1855] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:21 2022] PUT /identity/v3/projects/7ceb77dfbb484d0ab95ca0a43490a7fb/users/05699bd75d8b4824b3fd35041190964e/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:21.271828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.282313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821109fc-d368-47f4-a137-a9cb438d8d47 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.338731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea9b49-cfdc-44d4-bf1c-d4d7df006c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.339312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea9b49-cfdc-44d4-bf1c-d4d7df006c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.339633 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea9b49-cfdc-44d4-bf1c-d4d7df006c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.339918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea9b49-cfdc-44d4-bf1c-d4d7df006c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.340636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea9b49-cfdc-44d4-bf1c-d4d7df006c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.342232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea9b49-cfdc-44d4-bf1c-d4d7df006c17 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.355695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 935/1856] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:21.356828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.370717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167dd81-17a0-4841-ab4f-c86c929e0760 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.375461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.376492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.376783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.377060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] PATH_INFO: `/v3/projects/7ceb77dfbb484d0ab95ca0a43490a7fb/users/05699bd75d8b4824b3fd35041190964e/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.379074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ceb77dfbb484d0ab95ca0a43490a7fb, user_id=05699bd75d8b4824b3fd35041190964e, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.381732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.393533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 922/1857] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:21 2022] PUT /identity/v3/projects/7ceb77dfbb484d0ab95ca0a43490a7fb/users/05699bd75d8b4824b3fd35041190964e/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:21.404601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.404994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.405279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.431848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] MFA Rules not processed for user `05699bd75d8b4824b3fd35041190964e`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:21.433612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:21.497715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 936/1858] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:21.508253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.509972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:21.563847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b6074-d12b-4a76-b96b-63da2d50aa52 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.567426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbff225-9ab0-426e-bc06-fc0c97044547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.568086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff225-9ab0-426e-bc06-fc0c97044547 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.568370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff225-9ab0-426e-bc06-fc0c97044547 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.568650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff225-9ab0-426e-bc06-fc0c97044547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.577338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbff225-9ab0-426e-bc06-fc0c97044547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.578752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbff225-9ab0-426e-bc06-fc0c97044547 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.588574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 923/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:21.717405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.790111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d52a70-c706-4047-bd7d-ec087afb41e7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:21.794946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:21.795726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.796008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.796285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] PATH_INFO: `/v3/users/cb095a370c074b43837216a08cc1bac5` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.797518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb095a370c074b43837216a08cc1bac5)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:21.799436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:21.843655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb095a370c074b43837216a08cc1bac5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:21.844240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb095a370c074b43837216a08cc1bac5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:21.855503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb095a370c074b43837216a08cc1bac5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:21.864821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb095a370c074b43837216a08cc1bac5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:21.865447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb095a370c074b43837216a08cc1bac5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:21.877676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 937/1860] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:21 2022] DELETE /identity/v3/users/cb095a370c074b43837216a08cc1bac5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:21.882264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:21.882656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:21.883020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:21.901539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:21.902824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:21.962338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 924/1861] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:21.972142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:21.973540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:22.038107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3737c2-9f0f-422d-adc9-6a0f7f3d92b4 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:22.042369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:22.043031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:22.043315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:22.043622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:22.052484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:22.053919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:22.063871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 938/1862] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:22.319064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:22.320511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:22.332742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa606ec1-9ad5-4020-bc51-420d81025dd8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:22.337630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:22.338495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:22.339321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:22.340259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] PATH_INFO: `/v3/projects/29f01611b2524fcebdd12e99ec11045c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:22.341632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f01611b2524fcebdd12e99ec11045c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:22.343560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:22.397409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f01611b2524fcebdd12e99ec11045c', 'request_id': 'req-92735c8c-3300-4899-af4c-bc07ccf2e046'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.405843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f01611b2524fcebdd12e99ec11045c', 'request_id': 'req-92735c8c-3300-4899-af4c-bc07ccf2e046'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.411077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f01611b2524fcebdd12e99ec11045c', 'request_id': 'req-92735c8c-3300-4899-af4c-bc07ccf2e046'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.424242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] The token cache is being invalidate because project 29f01611b2524fcebdd12e99ec11045c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:22.424539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.425207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.426947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 925/1863] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:22 2022] DELETE /identity/v3/projects/29f01611b2524fcebdd12e99ec11045c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:22.430838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:22.440299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfd14c-c3a1-46f4-9e09-15af57f87891 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:22.493871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:22.494776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:22.495060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:22.495394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] PATH_INFO: `/v3/users/05699bd75d8b4824b3fd35041190964e` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:22.496657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05699bd75d8b4824b3fd35041190964e)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:22.498612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:22.543917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05699bd75d8b4824b3fd35041190964e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.544595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05699bd75d8b4824b3fd35041190964e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.557457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05699bd75d8b4824b3fd35041190964e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.564727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05699bd75d8b4824b3fd35041190964e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.565345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4fd6fb09-5820-48db-afaa-7fae061cdb36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05699bd75d8b4824b3fd35041190964e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:22.577453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 939/1864] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:22 2022] DELETE /identity/v3/users/05699bd75d8b4824b3fd35041190964e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:22.846937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:22.849176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:22.864447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92735c8c-3300-4899-af4c-bc07ccf2e046 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:22.942274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:22.943443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:22.943924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:22.944450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] PATH_INFO: `/v3/projects/7ceb77dfbb484d0ab95ca0a43490a7fb` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:22.945918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ceb77dfbb484d0ab95ca0a43490a7fb)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:22.948630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.008316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ceb77dfbb484d0ab95ca0a43490a7fb', 'request_id': 'req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.021711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ceb77dfbb484d0ab95ca0a43490a7fb', 'request_id': 'req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.044433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ceb77dfbb484d0ab95ca0a43490a7fb', 'request_id': 'req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.072287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] The token cache is being invalidate because project 7ceb77dfbb484d0ab95ca0a43490a7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:23.073117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.074595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5cf48816-c9ab-4f35-9b20-35b6ae00db4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.079826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 926/1865] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:22 2022] DELETE /identity/v3/projects/7ceb77dfbb484d0ab95ca0a43490a7fb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:23.085298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.086200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.086672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.138150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:23.139663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.209669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 940/1866] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:23.217070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.217366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.217646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.237128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:23.238335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.246945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 927/1867] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:23.251462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.261352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdbaa-3997-41aa-b754-e6bc3e4a91e4 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.266151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.266820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.267105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.267385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.268153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:23.268459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.270095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.282478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 941/1868] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:23.286597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.295781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c8b9f-7451-41cb-a6b9-9897e913b8ae None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.300406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.301050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.301337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.301613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.302297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.304244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.329531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 928/1869] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/projects => generated 407 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:23.333608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.343335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2d847-8915-4ec2-ac0c-c109f3d3732c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.408588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.409741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.410191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.410661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.411678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.414374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.443490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 942/1870] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/users => generated 304 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:23.447092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.464285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab8260-1f26-46b4-9629-a371e9347892 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.469459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.470180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.470467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.470747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.471481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.473131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.488769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 929/1871] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:23.492862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.504502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334ab1c-d7f4-4dfd-b69a-0b4d84da169a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.509816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.510976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.511631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.512228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.513140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.514927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.527125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 943/1872] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:23.531000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.542378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25060f-1d09-4a0b-aa5d-f673f2087f46 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.549896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b08c8-04da-4982-9a26-37ab2ce5402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.549896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b08c8-04da-4982-9a26-37ab2ce5402b admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.549896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b08c8-04da-4982-9a26-37ab2ce5402b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.549896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b08c8-04da-4982-9a26-37ab2ce5402b admin admin] PATH_INFO: `/v3/projects/2ffb7457ce88452e9fd09269e4f090a3/users/ba3e4ee5118a4d15b2ac7fb2dc408f02/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.569791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.571912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.574854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b08c8-04da-4982-9a26-37ab2ce5402b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffb7457ce88452e9fd09269e4f090a3, user_id=ba3e4ee5118a4d15b2ac7fb2dc408f02, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.577806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b08c8-04da-4982-9a26-37ab2ce5402b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.586386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1f2c5-504c-4ed6-a490-f7a44e3a91fc admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.590530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 930/1873] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:23 2022] PUT /identity/v3/projects/2ffb7457ce88452e9fd09269e4f090a3/users/ba3e4ee5118a4d15b2ac7fb2dc408f02/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:23.600568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.600857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.601166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.634584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] MFA Rules not processed for user `ba3e4ee5118a4d15b2ac7fb2dc408f02`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:23.635923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.654475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.655441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.655850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.656134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] PATH_INFO: `/v3/users/49939e8572a248fe9474fa5ca1c9b490` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.657470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49939e8572a248fe9474fa5ca1c9b490)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.659397 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.702984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 931/1874] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:23.707057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.710683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49939e8572a248fe9474fa5ca1c9b490'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.711427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49939e8572a248fe9474fa5ca1c9b490'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.717901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b23a2d-9175-4809-a1d1-aa5e6a093523 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.723642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.723801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49939e8572a248fe9474fa5ca1c9b490'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.724898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.724898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.725320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.725976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.728166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.732137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49939e8572a248fe9474fa5ca1c9b490'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.732886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-21460268-7c18-4ba4-b8b8-4af590ccc357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49939e8572a248fe9474fa5ca1c9b490'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:23.746377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 944/1875] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:23 2022] DELETE /identity/v3/users/49939e8572a248fe9474fa5ca1c9b490 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:23.753574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.754107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.754453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.772248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 932/1876] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/projects => generated 409 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:23.772741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:23.773960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.774058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.775949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.832498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 945/1877] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:23.836216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6bcfe-f555-42db-8670-e3354b106e86 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.841439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.842119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.842404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.842644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.842737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.843366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.843999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:23.845340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.867735 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 933/1878] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:23 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:23.868717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.878043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f8989-57f4-478f-92eb-f2e9931f6902 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.882648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.883302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.883606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.883889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.884601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.886202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.900505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 934/1879] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:23.900711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8390e1-34b5-4373-92fd-1868694ccbc0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.902182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.906427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.907256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.907559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.907991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.914888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3dc6-1d1b-446b-8063-7c8f16a7ea4d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:23.920019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.921915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.934445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 946/1880] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:23.937031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:23.937938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:23.938227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:23.938509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] PATH_INFO: `/v3/projects/fe2f44068d6247738621c09190fa758d/users/20333b7f11d44dae943f15e8ca7d6dcf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:23.954256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2f44068d6247738621c09190fa758d, user_id=20333b7f11d44dae943f15e8ca7d6dcf, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:23.957057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:23.972843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 935/1881] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:23 2022] PUT /identity/v3/projects/fe2f44068d6247738621c09190fa758d/users/20333b7f11d44dae943f15e8ca7d6dcf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:23.977437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:23.988351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433a82b-2687-451c-a80e-b50367841378 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:24.067830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b547d-01ad-44ef-a0dd-4eb479d5aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:24.069684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b547d-01ad-44ef-a0dd-4eb479d5aab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:24.069854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b547d-01ad-44ef-a0dd-4eb479d5aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:24.070211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b547d-01ad-44ef-a0dd-4eb479d5aab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:24.070858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b547d-01ad-44ef-a0dd-4eb479d5aab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:24.072502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b547d-01ad-44ef-a0dd-4eb479d5aab5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:24.087714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 947/1882] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:24.090551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:24.102890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf51e0e-9b33-4ecd-915b-2f316623a927 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:24.109980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:24.110989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:24.111459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:24.111828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] PATH_INFO: `/v3/projects/fe2f44068d6247738621c09190fa758d/users/20333b7f11d44dae943f15e8ca7d6dcf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:24.114484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2f44068d6247738621c09190fa758d, user_id=20333b7f11d44dae943f15e8ca7d6dcf, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:24.118167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:24.130545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 936/1883] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:24 2022] PUT /identity/v3/projects/fe2f44068d6247738621c09190fa758d/users/20333b7f11d44dae943f15e8ca7d6dcf/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:24.143848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:24.144317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:24.144744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:24.178902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] MFA Rules not processed for user `20333b7f11d44dae943f15e8ca7d6dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:24.180876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:24.302495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 948/1884] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:24.357353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:24.359270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:24.477348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4a33-d3eb-48b0-8eaa-a56863588594 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:24.490152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:24.491625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:24.492364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:24.493036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:24.509546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:24.511577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:24.527285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 937/1885] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:24.878417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:24.880411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:24.898405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e540-aa98-4a9f-852f-fe50ce998887 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:24.903670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:24.904625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:24.905133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:24.905415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:24.907455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:24.931206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:24.932966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:25.034174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:25.036201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:25.054954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 949/1886] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:25.079465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c8a21-c8b0-43a4-84fd-6352bf31a2d7 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:25.098197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:25.099086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:25.099374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:25.102447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] PATH_INFO: `/v3/projects/2e90a46820ed47ee9e77688c016fe238` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:25.105575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e90a46820ed47ee9e77688c016fe238)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:25.108585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:25.178787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e90a46820ed47ee9e77688c016fe238', 'request_id': 'req-ca85d746-58cb-4774-a901-d6a754ec5955'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.191438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e90a46820ed47ee9e77688c016fe238', 'request_id': 'req-ca85d746-58cb-4774-a901-d6a754ec5955'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.200105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e90a46820ed47ee9e77688c016fe238', 'request_id': 'req-ca85d746-58cb-4774-a901-d6a754ec5955'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.214241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] The token cache is being invalidate because project 2e90a46820ed47ee9e77688c016fe238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:25.214783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.215446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.222000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 938/1887] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:24 2022] DELETE /identity/v3/projects/2e90a46820ed47ee9e77688c016fe238 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:25.223222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:25.234075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ee5b6-cce2-4d60-b7d8-bae824705b42 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:25.313682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:25.314791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:25.315072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:25.315347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] PATH_INFO: `/v3/users/3f352eb8ac254170bd4eabe58b614e51` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:25.316725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f352eb8ac254170bd4eabe58b614e51)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:25.319409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:25.368603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f352eb8ac254170bd4eabe58b614e51'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.369530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f352eb8ac254170bd4eabe58b614e51'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.382014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f352eb8ac254170bd4eabe58b614e51'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.389469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f352eb8ac254170bd4eabe58b614e51'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.390141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-92158c24-5d12-478b-a8db-ff85add36678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f352eb8ac254170bd4eabe58b614e51'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.404618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 950/1888] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:25 2022] DELETE /identity/v3/users/3f352eb8ac254170bd4eabe58b614e51 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:25.767559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:25.769012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:25.786345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85d746-58cb-4774-a901-d6a754ec5955 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:25.895628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:25.902127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:25.902574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:25.902860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] PATH_INFO: `/v3/projects/0718cc73e7a34399a3172e4750047480` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:25.908222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0718cc73e7a34399a3172e4750047480)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:25.914634 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:25.973667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0718cc73e7a34399a3172e4750047480', 'request_id': 'req-c5d08754-2ab0-4960-8616-bb50182bbf29'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:25.982793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0718cc73e7a34399a3172e4750047480', 'request_id': 'req-c5d08754-2ab0-4960-8616-bb50182bbf29'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:26.000473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0718cc73e7a34399a3172e4750047480', 'request_id': 'req-c5d08754-2ab0-4960-8616-bb50182bbf29'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:26.015668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] The token cache is being invalidate because project 0718cc73e7a34399a3172e4750047480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:26.016029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:26.016769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c5d08754-2ab0-4960-8616-bb50182bbf29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:26.019935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 939/1889] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:25 2022] DELETE /identity/v3/projects/0718cc73e7a34399a3172e4750047480 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:26.024659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.025009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.025276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.050353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:26.052284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:26.119317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 951/1890] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:26.128148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.128445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.128729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.147424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:26.148643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:26.159071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 940/1891] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:26.160809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.172075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e455ce-c2dd-48b3-9a67-a76b10d84035 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.176834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.177500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.177786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.178063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.178847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:26.179164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.181080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.196487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 952/1892] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:26.197559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.207775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee543b4b-85a8-46c6-b08c-5a34c1f67340 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.211969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.212631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.212911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.213191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.213885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.216084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.241279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 941/1893] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:26.246003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.257391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffec786-e479-49e6-9a02-2a76e05e51d6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.332411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.333090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.333461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.333717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.334423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.336383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.362331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 953/1894] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:26.363626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.377807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f0ad-ccde-4752-8984-907dd0fb0c38 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.382865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.383556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.383924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.384212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.384946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.387134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.397675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 942/1895] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:26.401665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.411669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499c8d2-6915-412c-8b46-1b3e6b9fcdba admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.416366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb00c-6006-4fe3-94de-8fb0768e5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.417747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb00c-6006-4fe3-94de-8fb0768e5bad admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.418026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb00c-6006-4fe3-94de-8fb0768e5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.418324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb00c-6006-4fe3-94de-8fb0768e5bad admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.419088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb00c-6006-4fe3-94de-8fb0768e5bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.420932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb00c-6006-4fe3-94de-8fb0768e5bad admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.432018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 954/1896] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:26.436766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.452919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a036b-6781-4efd-8027-ae9cd334ee6d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.457632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.458547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.458833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.459115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] PATH_INFO: `/v3/projects/d03e56fe1e7f44feab12e3b72c2368cd/users/7cb16139911f457ab71921a527360f94/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.482589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03e56fe1e7f44feab12e3b72c2368cd, user_id=7cb16139911f457ab71921a527360f94, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.485256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.497513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 943/1897] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:26 2022] PUT /identity/v3/projects/d03e56fe1e7f44feab12e3b72c2368cd/users/7cb16139911f457ab71921a527360f94/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:26.507604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.507901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.508183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.535066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] MFA Rules not processed for user `7cb16139911f457ab71921a527360f94`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:26.536285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:26.598057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 955/1898] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:26.602435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.661017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a130d5-c36e-42e0-90bd-0aa5271a8739 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.665675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.666325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.666638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.666920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.667637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.669553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.695622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 944/1899] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:26.700063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.711314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0102326-cafe-4de3-841d-f2b759c8c11c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.779770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.780701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.780977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.781253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.781976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.784094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.803563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 956/1900] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:26 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:26.808189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.820626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51080d0-0069-4360-8a3f-02f1f5a79f66 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.827875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.828550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.828845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.829147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.829885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.831678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.846754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 945/1901] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:26.848009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.858111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68bcb-1fad-416d-8cb4-4c0839d6409f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.862680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.863578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.863912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.864189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] PATH_INFO: `/v3/projects/514f62816c03492792d52fe7f2772c9a/users/b2d6ab827eea4df7a88ed29bdb935725/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.879730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=514f62816c03492792d52fe7f2772c9a, user_id=b2d6ab827eea4df7a88ed29bdb935725, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.882428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.894625 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 957/1902] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:26 2022] PUT /identity/v3/projects/514f62816c03492792d52fe7f2772c9a/users/b2d6ab827eea4df7a88ed29bdb935725/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:26.898528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.908880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9e873-92e0-4443-9284-08163d706d84 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.963138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ab14e-f375-4385-9fb5-8691744f8d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.964398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab14e-f375-4385-9fb5-8691744f8d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.964682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab14e-f375-4385-9fb5-8691744f8d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.964955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ab14e-f375-4385-9fb5-8691744f8d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.965674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ab14e-f375-4385-9fb5-8691744f8d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:26.967280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ab14e-f375-4385-9fb5-8691744f8d3a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:26.977192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 946/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:26.981597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:26.991385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63688a49-abf5-4a48-b91a-b6d79dddbd5c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:26.996429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:26.997304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:26.997581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:26.997851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] PATH_INFO: `/v3/projects/514f62816c03492792d52fe7f2772c9a/users/b2d6ab827eea4df7a88ed29bdb935725/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:26.999834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514f62816c03492792d52fe7f2772c9a, user_id=b2d6ab827eea4df7a88ed29bdb935725, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:27.002437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:27.013891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 958/1904] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:26 2022] PUT /identity/v3/projects/514f62816c03492792d52fe7f2772c9a/users/b2d6ab827eea4df7a88ed29bdb935725/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:27.024837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:27.025136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:27.025421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:27.052039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] MFA Rules not processed for user `b2d6ab827eea4df7a88ed29bdb935725`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:27.053243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:27.158991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 947/1905] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:27.171030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:27.175052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:27.261135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2418a-8779-4026-9482-f01914576197 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:27.266168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:27.267033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:27.267726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:27.268377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:27.281221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:27.282856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:27.295176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 959/1906] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:27.477347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:27.500452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28a858-aa74-4845-8e79-f6f9c8958957 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:27.506468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276b421-ac72-417e-8989-f6b997407d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:27.507408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b421-ac72-417e-8989-f6b997407d16 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:27.507876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b421-ac72-417e-8989-f6b997407d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:27.508311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276b421-ac72-417e-8989-f6b997407d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:27.607978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b421-ac72-417e-8989-f6b997407d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:27.610395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276b421-ac72-417e-8989-f6b997407d16 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:27.624791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 948/1907] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:34.645594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:34.724806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0cc9b-3377-49e8-8205-153f1b8c89a6 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:34.730286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:34.731518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:34.731935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:34.732318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] PATH_INFO: `/v3/users/7cb16139911f457ab71921a527360f94` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:34.734306 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb16139911f457ab71921a527360f94)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:34.736597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:34.791515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb16139911f457ab71921a527360f94'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:34.792398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb16139911f457ab71921a527360f94'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:34.805619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb16139911f457ab71921a527360f94'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:34.814181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb16139911f457ab71921a527360f94'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:34.814832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb16139911f457ab71921a527360f94'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:34.829064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 960/1908] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:34 2022] DELETE /identity/v3/users/7cb16139911f457ab71921a527360f94 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:34.833578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:34.834086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:34.834194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:34.854649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:34.855955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:34.933917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 949/1909] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:34.943676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:34.945341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:35.013733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667fd32-1e01-41ca-abae-85fa683eaadb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:35.020447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:35.023082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:35.023629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:35.024148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:35.034992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:35.037463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:35.051278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 961/1910] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:35.413370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:35.415094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:35.436998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e6839-d0c8-4eef-8356-16caecdec396 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:35.443950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:35.445073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:35.446097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:35.446561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] PATH_INFO: `/v3/projects/d03e56fe1e7f44feab12e3b72c2368cd` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:35.450331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03e56fe1e7f44feab12e3b72c2368cd)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:35.453326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:35.515769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03e56fe1e7f44feab12e3b72c2368cd', 'request_id': 'req-eef3f260-e975-44af-8895-c6dce60c88fc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.523365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03e56fe1e7f44feab12e3b72c2368cd', 'request_id': 'req-eef3f260-e975-44af-8895-c6dce60c88fc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.530131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03e56fe1e7f44feab12e3b72c2368cd', 'request_id': 'req-eef3f260-e975-44af-8895-c6dce60c88fc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.541963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] The token cache is being invalidate because project d03e56fe1e7f44feab12e3b72c2368cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:35.542259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.542913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.544483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 950/1911] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:35 2022] DELETE /identity/v3/projects/d03e56fe1e7f44feab12e3b72c2368cd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:35.548587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:35.559354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546d9d5-5c5c-4f55-a9a5-0cf8e51911c0 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:35.613793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:35.614585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:35.614873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:35.615151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] PATH_INFO: `/v3/users/b2d6ab827eea4df7a88ed29bdb935725` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:35.616358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d6ab827eea4df7a88ed29bdb935725)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:35.618330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:35.663702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d6ab827eea4df7a88ed29bdb935725'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.664421 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d6ab827eea4df7a88ed29bdb935725'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.676001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d6ab827eea4df7a88ed29bdb935725'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.683417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d6ab827eea4df7a88ed29bdb935725'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.684077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0fc67b9d-3461-4020-8cf7-447302841ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d6ab827eea4df7a88ed29bdb935725'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:35.695591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 962/1912] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:35 2022] DELETE /identity/v3/users/b2d6ab827eea4df7a88ed29bdb935725 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:36.002092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.003553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:36.017542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3f260-e975-44af-8895-c6dce60c88fc admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.076957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.077817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.078103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.078376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] PATH_INFO: `/v3/projects/514f62816c03492792d52fe7f2772c9a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.079568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514f62816c03492792d52fe7f2772c9a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.081464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.124711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514f62816c03492792d52fe7f2772c9a', 'request_id': 'req-d7b69687-3311-4b74-8ea5-aaaabf4166f5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:36.139739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514f62816c03492792d52fe7f2772c9a', 'request_id': 'req-d7b69687-3311-4b74-8ea5-aaaabf4166f5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:36.149711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514f62816c03492792d52fe7f2772c9a', 'request_id': 'req-d7b69687-3311-4b74-8ea5-aaaabf4166f5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:36.170137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] The token cache is being invalidate because project 514f62816c03492792d52fe7f2772c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:36.170441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:36.171140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b69687-3311-4b74-8ea5-aaaabf4166f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:36.172963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 951/1913] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:36 2022] DELETE /identity/v3/projects/514f62816c03492792d52fe7f2772c9a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:36.177504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.177900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.178180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.196529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:36.198368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:36.255852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 963/1914] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:36.264147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.264447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.264733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.283640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:36.284850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:36.293893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 952/1915] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:36.297506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.307919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfba35-fcb6-4b6a-b182-0f426a8f8b0d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.312546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.313203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.313485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.313762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.314503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:36.314801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.316442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.328202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 964/1916] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:36.332427 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.341665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30794-7045-4923-8fcd-8c4edeb04b1d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.346319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.346979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.347343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.347621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.348316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.350276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.378217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 953/1917] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:36.382132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.392093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d429a1-ce46-4d99-962e-0c5427908301 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.445661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.446377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.446618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.446904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.447639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.449576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.467732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 965/1918] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:36.471762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.482259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c4e31-499a-44e0-bc3e-e27c0a1d014b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.486899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.487580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.487969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.488142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.488899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.490460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.501328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 954/1919] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:36.505191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.515186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd9640-f284-4bb6-8706-1e8863c61030 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.520007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dca83b-69d9-4ec2-92c3-b00a8949d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.520672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca83b-69d9-4ec2-92c3-b00a8949d55a admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.521042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca83b-69d9-4ec2-92c3-b00a8949d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.521231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dca83b-69d9-4ec2-92c3-b00a8949d55a admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.521996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dca83b-69d9-4ec2-92c3-b00a8949d55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.523701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dca83b-69d9-4ec2-92c3-b00a8949d55a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.534215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 966/1920] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:36.538223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.548798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f3929-4219-4c3f-a1df-0c25e07d8d68 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.553389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.554265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.554552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.555087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] PATH_INFO: `/v3/projects/e18a7bfe05db44c7b11b8875dbd6fd82/users/542947f650984460a6208b4da2273eb6/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.569230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18a7bfe05db44c7b11b8875dbd6fd82, user_id=542947f650984460a6208b4da2273eb6, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.571961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.585375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 955/1921] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:36 2022] PUT /identity/v3/projects/e18a7bfe05db44c7b11b8875dbd6fd82/users/542947f650984460a6208b4da2273eb6/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:36.595977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.596270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.596549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.626086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] MFA Rules not processed for user `542947f650984460a6208b4da2273eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:36.627326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:36.700982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 967/1922] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:36.705230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.775926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bed6e7-dff6-4cb3-b116-7cf580224ed5 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.781080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.781747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.782059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.782337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.783049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.784991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.810778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 956/1923] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:36.814759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.825195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ace7b-29fc-4dea-8ec2-4a63a8bac9c3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.878963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.879590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.879875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.880151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.880826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.882733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.901737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 968/1924] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:36 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:36.905618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.915585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4fa6-100e-45ce-ba22-e07307e9ee13 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.920298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.920990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.921275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.921556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.922276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.923987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.933930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 957/1925] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:36.937780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:36.948034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471728c-fac1-411a-8036-c241519f8de8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:36.952650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:36.953526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:36.953807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:36.954108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] PATH_INFO: `/v3/projects/e3d90dddb2e548659f2f5918516e33e8/users/14cdfeb5505040caa0f80499025673c7/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:36.968809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d90dddb2e548659f2f5918516e33e8, user_id=14cdfeb5505040caa0f80499025673c7, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:36.971503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:36.985606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 969/1926] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:36 2022] PUT /identity/v3/projects/e3d90dddb2e548659f2f5918516e33e8/users/14cdfeb5505040caa0f80499025673c7/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:36.989749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:37.002056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd16c22-1c46-492f-b868-43cae214f655 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:37.059829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb8591-da74-42c7-9651-9ba1fe072c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:37.060508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb8591-da74-42c7-9651-9ba1fe072c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:37.060764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb8591-da74-42c7-9651-9ba1fe072c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:37.061038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb8591-da74-42c7-9651-9ba1fe072c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:37.061782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb8591-da74-42c7-9651-9ba1fe072c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:37.063391 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb8591-da74-42c7-9651-9ba1fe072c72 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:37.073684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 958/1927] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:37.077767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:37.088425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8505e-0c42-4d38-84d4-d8dd45e113bf admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:37.093021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:37.093899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:37.094182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:37.094460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] PATH_INFO: `/v3/projects/e3d90dddb2e548659f2f5918516e33e8/users/14cdfeb5505040caa0f80499025673c7/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:37.096480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d90dddb2e548659f2f5918516e33e8, user_id=14cdfeb5505040caa0f80499025673c7, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:37.099136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:37.109393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 970/1928] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:37 2022] PUT /identity/v3/projects/e3d90dddb2e548659f2f5918516e33e8/users/14cdfeb5505040caa0f80499025673c7/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:37.120413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:37.120710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:37.120993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:37.147912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] MFA Rules not processed for user `14cdfeb5505040caa0f80499025673c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:37.149041 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:37.215795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 959/1929] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:37.226318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:37.228074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:37.284283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1fbba-919d-465f-838e-c4c8a7fda0d7 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:37.288015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff0181-316e-4e45-99de-3e7c7a74c41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:37.288686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0181-316e-4e45-99de-3e7c7a74c41f service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:37.288966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0181-316e-4e45-99de-3e7c7a74c41f service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:37.289242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff0181-316e-4e45-99de-3e7c7a74c41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:37.298119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff0181-316e-4e45-99de-3e7c7a74c41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:37.299570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff0181-316e-4e45-99de-3e7c7a74c41f service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:37.309600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 971/1930] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:37.915413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:37.978783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b561a-fe48-48ad-98a0-5d7bbeba784d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:37.983321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:37.984218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:37.984504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:37.984780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] PATH_INFO: `/v3/users/542947f650984460a6208b4da2273eb6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:37.985944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=542947f650984460a6208b4da2273eb6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:37.987921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:38.032036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542947f650984460a6208b4da2273eb6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.039346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542947f650984460a6208b4da2273eb6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.052063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542947f650984460a6208b4da2273eb6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.052742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542947f650984460a6208b4da2273eb6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.060482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542947f650984460a6208b4da2273eb6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.066380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 960/1931] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:37 2022] DELETE /identity/v3/users/542947f650984460a6208b4da2273eb6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:38.070999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:38.071453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:38.071591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:38.089199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:38.090385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:38.145082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 972/1932] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:38.155407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:38.156882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:38.211612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd360c65-632f-4353-a8fa-840b57546c11 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:38.215665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:38.216301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:38.216586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:38.216870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:38.225522 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:38.226934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:38.236129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 961/1933] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:38.578217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:38.579802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:38.601904 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac36ad-3212-47d8-aef5-84ad5e9a00e5 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:38.609679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:38.610741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:38.611248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:38.611673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] PATH_INFO: `/v3/projects/e18a7bfe05db44c7b11b8875dbd6fd82` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:38.612958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18a7bfe05db44c7b11b8875dbd6fd82)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:38.617184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:38.675915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18a7bfe05db44c7b11b8875dbd6fd82', 'request_id': 'req-47191fe2-4cce-473e-8785-0a9bb511cbfd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.682262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18a7bfe05db44c7b11b8875dbd6fd82', 'request_id': 'req-47191fe2-4cce-473e-8785-0a9bb511cbfd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.687843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18a7bfe05db44c7b11b8875dbd6fd82', 'request_id': 'req-47191fe2-4cce-473e-8785-0a9bb511cbfd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.700785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] The token cache is being invalidate because project e18a7bfe05db44c7b11b8875dbd6fd82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:38.701073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.701723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.703295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 973/1934] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:38 2022] DELETE /identity/v3/projects/e18a7bfe05db44c7b11b8875dbd6fd82 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:38.707334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:38.717169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72536f58-63ed-4839-8f17-32008566e075 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:38.774888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:38.775838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:38.776119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:38.776392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] PATH_INFO: `/v3/users/14cdfeb5505040caa0f80499025673c7` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:38.777560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14cdfeb5505040caa0f80499025673c7)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:38.779498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:38.823372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14cdfeb5505040caa0f80499025673c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.830919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14cdfeb5505040caa0f80499025673c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.843905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14cdfeb5505040caa0f80499025673c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.844572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14cdfeb5505040caa0f80499025673c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.851343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8ab0b44f-eab8-4489-8ba6-1007218d857f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14cdfeb5505040caa0f80499025673c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:38.857834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 962/1935] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:38 2022] DELETE /identity/v3/users/14cdfeb5505040caa0f80499025673c7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:39.239134 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.241231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:39.254032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47191fe2-4cce-473e-8785-0a9bb511cbfd admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.311222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.312117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.312404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.312681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] PATH_INFO: `/v3/projects/e3d90dddb2e548659f2f5918516e33e8` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.313852 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d90dddb2e548659f2f5918516e33e8)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.315810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.361503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d90dddb2e548659f2f5918516e33e8', 'request_id': 'req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:39.367689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d90dddb2e548659f2f5918516e33e8', 'request_id': 'req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:39.373463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d90dddb2e548659f2f5918516e33e8', 'request_id': 'req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:39.385945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] The token cache is being invalidate because project e3d90dddb2e548659f2f5918516e33e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:39.386234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:39.386874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-06cdb550-c3f3-4cbf-ab73-acf561d9e53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:39.389100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 974/1936] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:39 2022] DELETE /identity/v3/projects/e3d90dddb2e548659f2f5918516e33e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:39.393869 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.394331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.394420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.412107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:39.413305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:39.470219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 963/1937] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:39.477587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.477879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.478665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.497373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:39.498504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:39.506391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 975/1938] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:39.510803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.520642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c44ca-7be6-4630-bd1e-abb76bd07f70 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.525305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.525966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.526252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.526530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.527287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:39.527628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.529223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.541795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 964/1939] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:39.546229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.555861 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976ab8-497c-442f-a220-ceb2b2b19c01 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.561272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.561928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.562213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.562493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.563269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.565130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.593873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 976/1940] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:39 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:39.594947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.604736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec144e3-6745-4d97-a554-fc5c1e034bf5 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.658407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.659084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.659375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.659695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.660418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.662318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.685069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 965/1941] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:39 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:58:39.688229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.700218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa89f3d-aa53-4835-ab39-154780f21c92 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.708120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.708807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.709097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.709426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.710111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.711738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.723383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 977/1942] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:39.727179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.737259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c615e-ca7f-4f34-a963-04c6014e05e5 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.742560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ae69-662b-40e1-b758-e07f7e32dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.743226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ae69-662b-40e1-b758-e07f7e32dd02 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.743514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ae69-662b-40e1-b758-e07f7e32dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.744980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ae69-662b-40e1-b758-e07f7e32dd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.745721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ae69-662b-40e1-b758-e07f7e32dd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.747557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426ae69-662b-40e1-b758-e07f7e32dd02 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.766093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 966/1943] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:39.770123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.782289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a10d05-6492-4d6b-8128-618e4b8ca27e admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:39.787417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:39.788417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.788806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.789085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] PATH_INFO: `/v3/projects/12cf51fc3bca46acbe2cb7af7a92b59c/users/7e296a6f0b144cc98812f26bf1f6a6f3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.805241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cf51fc3bca46acbe2cb7af7a92b59c, user_id=7e296a6f0b144cc98812f26bf1f6a6f3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:39.808009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:39.823189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 978/1944] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:39 2022] PUT /identity/v3/projects/12cf51fc3bca46acbe2cb7af7a92b59c/users/7e296a6f0b144cc98812f26bf1f6a6f3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:39.828497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cf74-9ba5-43bf-9705-a930561258ff None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:39.828965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cf74-9ba5-43bf-9705-a930561258ff None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:39.829406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cf74-9ba5-43bf-9705-a930561258ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:39.853680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-faa9cf74-9ba5-43bf-9705-a930561258ff None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:39.854964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-faa9cf74-9ba5-43bf-9705-a930561258ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:39.923455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 967/1945] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:39.933386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:39.935093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:40.002482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26d981-56df-4997-8c86-6fd2577f41a0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:40.006329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:40.007010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:40.007300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:40.007646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:40.018060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:40.019544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:40.029205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 979/1946] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:58:40.640954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:40.641473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:40.641473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:40.678226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] MFA Rules not processed for user `7e296a6f0b144cc98812f26bf1f6a6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:40.679431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:40.749171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 968/1947] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:40.777501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:40.778925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:40.846030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4e3dd-7187-46eb-ab75-7ca329cea438 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:40.849743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87260332-1229-48e4-9df4-1a7c505ef50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:40.850384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87260332-1229-48e4-9df4-1a7c505ef50e service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:40.850668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87260332-1229-48e4-9df4-1a7c505ef50e service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:40.850944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87260332-1229-48e4-9df4-1a7c505ef50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:40.859303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87260332-1229-48e4-9df4-1a7c505ef50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:40.860835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87260332-1229-48e4-9df4-1a7c505ef50e service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:40.869304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 980/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:45.494975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:45.496603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:45.510094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b053945-d565-46b1-b1fc-876d3879dafa None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:45.514918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:45.516293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:45.516293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:45.516506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] PATH_INFO: `/v3/users/ba3e4ee5118a4d15b2ac7fb2dc408f02` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:45.517642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3e4ee5118a4d15b2ac7fb2dc408f02)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:45.519594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:45.579068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3e4ee5118a4d15b2ac7fb2dc408f02'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:45.589204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3e4ee5118a4d15b2ac7fb2dc408f02'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:45.603442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3e4ee5118a4d15b2ac7fb2dc408f02'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:45.604301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3e4ee5118a4d15b2ac7fb2dc408f02'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:45.611403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3e4ee5118a4d15b2ac7fb2dc408f02'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:45.621668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 969/1949] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:45 2022] DELETE /identity/v3/users/ba3e4ee5118a4d15b2ac7fb2dc408f02 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:45.626173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:45.626650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:45.626762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:45.643853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:45.645398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:45.721564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 981/1950] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:45.733615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:45.735318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:45.809554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf5719-48e9-44bc-a8cb-f1e37c76349e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:45.813379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:45.814101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:45.814476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:45.814822 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:45.824531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:45.826071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:45.836106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 970/1951] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:46.103909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:46.105631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:46.118386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773cef2-82f6-41b0-88e7-48ec068f7f0a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:46.130666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:46.131770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:46.132039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:46.134390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] PATH_INFO: `/v3/projects/2ffb7457ce88452e9fd09269e4f090a3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:46.135698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffb7457ce88452e9fd09269e4f090a3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:46.138486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:46.189002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffb7457ce88452e9fd09269e4f090a3', 'request_id': 'req-b6192b88-e4e7-4552-952a-f12706aef7c2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.195191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffb7457ce88452e9fd09269e4f090a3', 'request_id': 'req-b6192b88-e4e7-4552-952a-f12706aef7c2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.201313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffb7457ce88452e9fd09269e4f090a3', 'request_id': 'req-b6192b88-e4e7-4552-952a-f12706aef7c2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.217157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] The token cache is being invalidate because project 2ffb7457ce88452e9fd09269e4f090a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:46.217393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.218137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b6192b88-e4e7-4552-952a-f12706aef7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.219838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 982/1952] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:46 2022] DELETE /identity/v3/projects/2ffb7457ce88452e9fd09269e4f090a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:46.224493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:46.235720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ac1e-d063-40e5-bd93-67144dab6d19 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:46.308036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:46.309399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:46.309898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:46.310705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] PATH_INFO: `/v3/users/20333b7f11d44dae943f15e8ca7d6dcf` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:46.312293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20333b7f11d44dae943f15e8ca7d6dcf)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:46.314303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:46.367666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20333b7f11d44dae943f15e8ca7d6dcf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.376750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20333b7f11d44dae943f15e8ca7d6dcf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.389321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20333b7f11d44dae943f15e8ca7d6dcf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.390353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20333b7f11d44dae943f15e8ca7d6dcf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.401288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20333b7f11d44dae943f15e8ca7d6dcf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:46.410476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 971/1953] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:46 2022] DELETE /identity/v3/users/20333b7f11d44dae943f15e8ca7d6dcf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:46.472221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f65f-9ac9-4484-adc5-498025bb5582 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:46.472611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f65f-9ac9-4484-adc5-498025bb5582 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:46.472982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263f65f-9ac9-4484-adc5-498025bb5582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:46.503109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c263f65f-9ac9-4484-adc5-498025bb5582 None None] MFA Rules not processed for user `7e296a6f0b144cc98812f26bf1f6a6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:46.506297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c263f65f-9ac9-4484-adc5-498025bb5582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:46.585408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 983/1954] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:46.880262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:46.882135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.003685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab67e-4a40-4458-bb3f-66e9d1c393c0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.008517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.010063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.010491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.011101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] PATH_INFO: `/v3/projects/fe2f44068d6247738621c09190fa758d` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.012481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2f44068d6247738621c09190fa758d)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.015157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.083516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2f44068d6247738621c09190fa758d', 'request_id': 'req-fa42565b-6e64-4a22-968f-f872b0ccede5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.099602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2f44068d6247738621c09190fa758d', 'request_id': 'req-fa42565b-6e64-4a22-968f-f872b0ccede5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.106198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2f44068d6247738621c09190fa758d', 'request_id': 'req-fa42565b-6e64-4a22-968f-f872b0ccede5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.132154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] The token cache is being invalidate because project fe2f44068d6247738621c09190fa758d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:47.132479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.133173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.139649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 972/1955] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:46 2022] DELETE /identity/v3/projects/fe2f44068d6247738621c09190fa758d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:47.140430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef638-487b-4864-b929-df7f88886245 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.141227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef638-487b-4864-b929-df7f88886245 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.141514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef638-487b-4864-b929-df7f88886245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.170700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-65cef638-487b-4864-b929-df7f88886245 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:47.171911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-65cef638-487b-4864-b929-df7f88886245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.200225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.202608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.280331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 984/1956] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:47.282213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42565b-6e64-4a22-968f-f872b0ccede5 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.288445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.288744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.289030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.297126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.298076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.298362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.298845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] PATH_INFO: `/v3/users/52c866ddbec94cdb8268ef06ffd49654` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.300299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c866ddbec94cdb8268ef06ffd49654)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.302970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.310654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:47.311947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.322259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 985/1957] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:47.326364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.342071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df1ec4-27f3-4e0b-8fd4-bdd1f101139c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.353760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.354438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.354731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.355004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.355759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:47.356066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.357686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.372679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c866ddbec94cdb8268ef06ffd49654'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.383585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 986/1958] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:47.385841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.386892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c866ddbec94cdb8268ef06ffd49654'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.397535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a9731-6aa3-4723-9180-906ed864bd6b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.403906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.404979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.405480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.405967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.406830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c866ddbec94cdb8268ef06ffd49654'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.407253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.407762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c866ddbec94cdb8268ef06ffd49654'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.409889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.416629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-885f14ff-d49c-4fa0-bcde-da4fc812240f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c866ddbec94cdb8268ef06ffd49654'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:47.425360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 973/1959] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:47 2022] DELETE /identity/v3/users/52c866ddbec94cdb8268ef06ffd49654 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:47.430308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.430758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.430910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.450646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 987/1960] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:47 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:47.456782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.458670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.458791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:47.460463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.533311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71752163-bda5-40cc-a0b3-fc00c7b853d3 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.539100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.540482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.540948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.541155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.541864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.544816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.550703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 974/1961] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:47.575962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 988/1962] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:47 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:47.576792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.577096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.579762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.589106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730064d7-727f-4ee6-85cb-8f5ede1492ba None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.603657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.604492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.604778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.605052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.605926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.607520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.635417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 975/1963] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:47.639138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.650033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61db38-9629-4169-acee-b373312d70a0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.655560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.656300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.656650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.656994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.657833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.659565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.662620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e3c80-20e1-4cfa-acb8-a32796099c33 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.667928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a59ba-e54a-4265-9325-c9703c2c4730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.668683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a59ba-e54a-4265-9325-c9703c2c4730 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.669027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a59ba-e54a-4265-9325-c9703c2c4730 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.669317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a59ba-e54a-4265-9325-c9703c2c4730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.674849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 976/1964] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:47.678689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.684438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a59ba-e54a-4265-9325-c9703c2c4730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.686768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a59ba-e54a-4265-9325-c9703c2c4730 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.692215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f2d42-6f80-4800-a0b4-d7c3d2a22b9b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.700075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.701610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 989/1965] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:47.704381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.704677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.704962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] PATH_INFO: `/v3/projects/4c4730ff98d245029d3d358ba9ed29d4/users/13f7154f3331436a9b5fdbb8c1600a6b/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.725279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4730ff98d245029d3d358ba9ed29d4, user_id=13f7154f3331436a9b5fdbb8c1600a6b, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:47.728873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:47.750687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 977/1966] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:47 2022] PUT /identity/v3/projects/4c4730ff98d245029d3d358ba9ed29d4/users/13f7154f3331436a9b5fdbb8c1600a6b/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:47.755972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.756266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.756507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:47.779199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:47.780338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:47.867560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 990/1967] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:47.922165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:47.983908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188139a5-e13b-40e6-838c-0e55bcd45213 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:47.988395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:47.989215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:47.989511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:47.989845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:48.002493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:48.004019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:48.017644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 978/1968] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:48.671378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:48.672927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:48.692262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891be1-28b7-498b-8023-425b28e4b7ba None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:48.704152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:48.705039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:48.705324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:48.705600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] PATH_INFO: `/v3/projects/7a9dfb27d3cc4ce6b6e479c56067c104` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:48.708314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9dfb27d3cc4ce6b6e479c56067c104)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:48.710410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:48.775872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9dfb27d3cc4ce6b6e479c56067c104', 'request_id': 'req-78e1572d-4061-4661-9beb-0e099a7a1529'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:48.784729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9dfb27d3cc4ce6b6e479c56067c104', 'request_id': 'req-78e1572d-4061-4661-9beb-0e099a7a1529'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:48.794300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9dfb27d3cc4ce6b6e479c56067c104', 'request_id': 'req-78e1572d-4061-4661-9beb-0e099a7a1529'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:48.811907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] The token cache is being invalidate because project 7a9dfb27d3cc4ce6b6e479c56067c104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:48.812548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:48.814331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:48.816781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 991/1969] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:48 2022] DELETE /identity/v3/projects/7a9dfb27d3cc4ce6b6e479c56067c104 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:48.820903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:48.832022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9590648-cda1-475c-929c-51ce7102f263 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:48.933824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:48.936219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:48.936992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:48.937763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] PATH_INFO: `/v3/users/6c8bb1c257e44638a48127b08fc76c0c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:48.957563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8bb1c257e44638a48127b08fc76c0c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:48.963784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:49.111663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8bb1c257e44638a48127b08fc76c0c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:49.130245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8bb1c257e44638a48127b08fc76c0c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:49.157225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8bb1c257e44638a48127b08fc76c0c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:49.160729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8bb1c257e44638a48127b08fc76c0c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:49.173810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8103d1dc-a7cf-401f-b8cd-4f1432ea4f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8bb1c257e44638a48127b08fc76c0c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:49.186368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 979/1970] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:58:48 2022] DELETE /identity/v3/users/6c8bb1c257e44638a48127b08fc76c0c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:49.688791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:49.688791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:49.763954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1572d-4061-4661-9beb-0e099a7a1529 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:49.855132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:49.855429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:49.855834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:49.917315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] MFA Rules not processed for user `13f7154f3331436a9b5fdbb8c1600a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:49.918463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:49.925283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:49.926689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:49.929459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:49.930863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] PATH_INFO: `/v3/projects/59e0513fd15a41a39abf5f56cea24161` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:49.933779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e0513fd15a41a39abf5f56cea24161)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:49.939268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.025818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 980/1971] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:50.033865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.035485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:50.050623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e0513fd15a41a39abf5f56cea24161', 'request_id': 'req-4103f0e2-effa-43ee-8e15-cfad9027f1b3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:50.077819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c3aec-18a5-4a91-b8d0-49fbd9a01773 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.085095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e0513fd15a41a39abf5f56cea24161', 'request_id': 'req-4103f0e2-effa-43ee-8e15-cfad9027f1b3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:50.116476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e0513fd15a41a39abf5f56cea24161', 'request_id': 'req-4103f0e2-effa-43ee-8e15-cfad9027f1b3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:50.155050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] The token cache is being invalidate because project 59e0513fd15a41a39abf5f56cea24161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:58:50.155346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:50.165040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-4103f0e2-effa-43ee-8e15-cfad9027f1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:58:50.170387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 992/1972] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:58:49 2022] DELETE /identity/v3/projects/59e0513fd15a41a39abf5f56cea24161 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:50.177471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d36ed-a731-4fc6-8995-4d0df375a523 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.177768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d36ed-a731-4fc6-8995-4d0df375a523 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.178112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d36ed-a731-4fc6-8995-4d0df375a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.217435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e74d36ed-a731-4fc6-8995-4d0df375a523 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:50.218122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e74d36ed-a731-4fc6-8995-4d0df375a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:50.261386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.262124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.262420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.262733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.263450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.268827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.325363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 981/1973] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:50 2022] POST /identity/v3/projects => generated 373 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:50.325887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.327793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:50.377885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 993/1974] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:50.386415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.386977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.387270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.421654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:50.422946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:50.452843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b0e0-f028-4339-859e-4383bbbc4613 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.465778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.466467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.466754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.467033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.467759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.469698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.531466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 982/1975] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:50 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:50.533587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.535233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 994/1976] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:50.541210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.552484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c12ed5-ae44-4f46-8894-2a33f1170dc0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.554491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36900da-ba66-4240-8cae-1b3fd275ef17 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.561553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.562456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.562865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.563232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.564144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:58:50.564526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.566426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.575549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.576236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.576524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.576806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.577542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.579146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.590873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 995/1977] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:58:50.592700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.604778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04759e-c28f-44ad-8937-8ea0256c9ec0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.605088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 983/1978] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:50.609875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.619619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.620319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.620623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.622627 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.624057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.626078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55171dc-4e6a-426b-a7a6-9b36d301c1aa admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.628648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.640002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.641152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.641449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.641882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] PATH_INFO: `/v3/projects/316475acd4bc4b938ed58ed058bcecae/users/237f99144aa04990914d085eab35f712/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.664507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316475acd4bc4b938ed58ed058bcecae, user_id=237f99144aa04990914d085eab35f712, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.695607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 996/1979] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:50 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:50.697770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.701565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.724846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 984/1980] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:50 2022] PUT /identity/v3/projects/316475acd4bc4b938ed58ed058bcecae/users/237f99144aa04990914d085eab35f712/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:50.730392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:50.928495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcaaae-7bc3-4d85-9e6e-085fce1dcb66 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.948196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.951412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.951630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0632134-3adf-48f5-80a2-e7d6232e44b8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:50.951734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.951989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.952834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.959019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:50.967930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:50.968685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:50.972358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:50.972657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:50.973435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:50.981004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.018186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 997/1981] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:50 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:51.019608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.021913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 985/1982] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:51.026629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.037869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4440f9-32d4-4d10-b025-1136ae107341 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.057784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.058635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.059050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.059431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.060449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.062425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.069256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ad77-7b14-4d4d-8177-25f27075af8a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.081840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.084491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.084955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 998/1983] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:51.085231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.085659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] PATH_INFO: `/v3/projects/316475acd4bc4b938ed58ed058bcecae/users/237f99144aa04990914d085eab35f712/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.088604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.092062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316475acd4bc4b938ed58ed058bcecae, user_id=237f99144aa04990914d085eab35f712, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.098316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.119700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff2a5-bd4f-47d3-ae00-8962a950cfdf admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.141052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 986/1984] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:51 2022] PUT /identity/v3/projects/316475acd4bc4b938ed58ed058bcecae/users/237f99144aa04990914d085eab35f712/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:58:51.301254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546936fe-719c-44c7-bcb6-0ab5a2e005c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.302381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546936fe-719c-44c7-bcb6-0ab5a2e005c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.302836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546936fe-719c-44c7-bcb6-0ab5a2e005c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.303280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546936fe-719c-44c7-bcb6-0ab5a2e005c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.304600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546936fe-719c-44c7-bcb6-0ab5a2e005c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.309200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546936fe-719c-44c7-bcb6-0ab5a2e005c5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.331845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 999/1985] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:51.336207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.360942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03eebd-81aa-4b7d-8c26-868eb95bf424 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.368747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.370108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.370546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.370971 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] PATH_INFO: `/v3/projects/e422c1baeb8e4caba69ec02e7a9afb8b/users/402078903fcc41599338ec99486d221a/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.396985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e422c1baeb8e4caba69ec02e7a9afb8b, user_id=402078903fcc41599338ec99486d221a, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.400548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.420658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 987/1986] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:51 2022] PUT /identity/v3/projects/e422c1baeb8e4caba69ec02e7a9afb8b/users/402078903fcc41599338ec99486d221a/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:51.433279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.433279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.433279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.467329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] MFA Rules not processed for user `402078903fcc41599338ec99486d221a`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:51.468901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:51.591094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1000/1987] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:51.595784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.692545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1dc06-6def-4c64-9939-e8cb9600714e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.698197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.699045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.699334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.699719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.700498 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.702831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.749671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.761130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 988/1988] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:58:51 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:51.775270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae91411-c4d1-4449-ac99-95a095fff015 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.873811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.874695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.875056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.876058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.876931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.879478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.907108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1001/1989] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:58:51 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:58:51.911296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.924070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44aaa8-60ef-43b4-91d1-4fadad5391de admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.937009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.939430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.939685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.940221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:51.941781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:51.943579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:51.971497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 989/1990] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:58:51.973330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:51.986206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53371730-451d-4667-81ef-7266b80ddb57 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:51.994871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:51.994871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:51.994871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:51.995250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] PATH_INFO: `/v3/projects/3776c628284642868e9ee10f82166bdd/users/07185b56b3bd42a9a66aeebd9d9b41ef/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.021966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3776c628284642868e9ee10f82166bdd, user_id=07185b56b3bd42a9a66aeebd9d9b41ef, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:52.026295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:52.064104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1002/1991] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:51 2022] PUT /identity/v3/projects/3776c628284642868e9ee10f82166bdd/users/07185b56b3bd42a9a66aeebd9d9b41ef/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:52.067895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:52.081120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fda82c-de73-4735-b9c3-b4b05b6d4e3e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:52.175417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d43c2-0775-4883-8f2a-8a958326999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:52.176351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d43c2-0775-4883-8f2a-8a958326999b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:52.176708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d43c2-0775-4883-8f2a-8a958326999b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:52.177065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d43c2-0775-4883-8f2a-8a958326999b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.177866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d43c2-0775-4883-8f2a-8a958326999b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:52.179890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d43c2-0775-4883-8f2a-8a958326999b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:52.199249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 990/1992] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:58:52.199922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:52.222853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034c60-2e41-40d7-a87f-e71da565228b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:52.228336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:52.229471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:52.229708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:52.229915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] PATH_INFO: `/v3/projects/3776c628284642868e9ee10f82166bdd/users/07185b56b3bd42a9a66aeebd9d9b41ef/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.232468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3776c628284642868e9ee10f82166bdd, user_id=07185b56b3bd42a9a66aeebd9d9b41ef, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:52.242673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:52.259576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1003/1993] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:58:52 2022] PUT /identity/v3/projects/3776c628284642868e9ee10f82166bdd/users/07185b56b3bd42a9a66aeebd9d9b41ef/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:58:52.268898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:52.269966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:52.270360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.312025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] MFA Rules not processed for user `07185b56b3bd42a9a66aeebd9d9b41ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:52.313874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:52.490696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 991/1994] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:58:52.502213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:52.504332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:52.606118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a092-df1a-4808-a38a-f14d84023875 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:52.616277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeb337-508a-49a2-b325-fe03f331e7fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:52.617530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeb337-508a-49a2-b325-fe03f331e7fe service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:52.618544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeb337-508a-49a2-b325-fe03f331e7fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:52.619071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeb337-508a-49a2-b325-fe03f331e7fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.648568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeb337-508a-49a2-b325-fe03f331e7fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:52.651472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeb337-508a-49a2-b325-fe03f331e7fe service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:52.686009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1004/1995] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:52.765710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:52.778162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac311b-1613-4136-ba51-ed80c339af1b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:52.782867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:52.783129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:52.783392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:52.784140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.865941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:52.867762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:52.894150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 992/1996] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:52.898639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:52.899639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:52.900080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:52.960050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] MFA Rules not processed for user `237f99144aa04990914d085eab35f712`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:58:52.961583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:53.088873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1005/1997] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:58:53.102388 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:53.115475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0909b-6062-4e59-b7f5-f96db9c5d2b0 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:53.126314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:53.126314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:53.126314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:53.126314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:53.126797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:58:53.191075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:53.192544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:53.201400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 993/1998] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:58:54.550124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:58:54.560366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478cf5c-04e5-4710-9223-0f02c9b49697 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:58:54.563864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:58:54.564536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:58:54.564822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:58:54.565101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:58:54.574676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:58:54.576184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:58:54.585243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1006/1999] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:04.759079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:04.760601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:04.845989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fb9b6-5d48-4907-9ddb-97ba1d271b1e service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:04.855166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:04.856605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:04.857061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:04.857485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] PATH_INFO: `/v3/users/121a7604047f47bd8ce4f490f51348b0` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:04.858874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121a7604047f47bd8ce4f490f51348b0)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:04.861546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:04.870789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:04.882994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de4a62-0358-4493-a6db-60c59af2f9ab service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:04.887908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:04.888830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:04.889115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:04.889392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] PATH_INFO: `/v3/users/402078903fcc41599338ec99486d221a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:04.890619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] RBAC: Authorizing `identity:delete_user(user_id=402078903fcc41599338ec99486d221a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:04.892871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:04.924590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121a7604047f47bd8ce4f490f51348b0'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.932760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121a7604047f47bd8ce4f490f51348b0'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.941243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402078903fcc41599338ec99486d221a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.941895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402078903fcc41599338ec99486d221a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.945612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121a7604047f47bd8ce4f490f51348b0'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.946494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121a7604047f47bd8ce4f490f51348b0'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.955771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402078903fcc41599338ec99486d221a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.961403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e85f95f-bf93-4442-bbc8-58a413538374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121a7604047f47bd8ce4f490f51348b0'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.965727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402078903fcc41599338ec99486d221a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.967108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402078903fcc41599338ec99486d221a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:04.971807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 994/2000] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:04 2022] DELETE /identity/v3/users/121a7604047f47bd8ce4f490f51348b0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:04.982797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1007/2001] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:04 2022] DELETE /identity/v3/users/402078903fcc41599338ec99486d221a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:04.987402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:04.987729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:04.988129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.008812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:05.010036 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.083793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 995/2002] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:05.093596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.096096 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.167080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86502de-bc81-4f75-867c-f5c876ce18da admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.171912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f4c0-6d85-4839-9bc9-961e94f60a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.173144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f4c0-6d85-4839-9bc9-961e94f60a74 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.173447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f4c0-6d85-4839-9bc9-961e94f60a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.173709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f4c0-6d85-4839-9bc9-961e94f60a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.185525 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22f4c0-6d85-4839-9bc9-961e94f60a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.187128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22f4c0-6d85-4839-9bc9-961e94f60a74 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.200776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1008/2003] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:05.208714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.211265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.228979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14463-3f5c-45b9-99ea-04ce9685bfd3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.234593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.235699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.236096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.236435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] PATH_INFO: `/v3/projects/f914e82002554d84bd9f3ae854c070ad` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.237768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f914e82002554d84bd9f3ae854c070ad)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.240239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.304126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f914e82002554d84bd9f3ae854c070ad', 'request_id': 'req-ade8fb5b-6dad-4139-9c2e-76300e7d5876'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.313517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f914e82002554d84bd9f3ae854c070ad', 'request_id': 'req-ade8fb5b-6dad-4139-9c2e-76300e7d5876'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.319234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f914e82002554d84bd9f3ae854c070ad', 'request_id': 'req-ade8fb5b-6dad-4139-9c2e-76300e7d5876'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.335472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] The token cache is being invalidate because project f914e82002554d84bd9f3ae854c070ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:05.335981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.336771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ade8fb5b-6dad-4139-9c2e-76300e7d5876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.338472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 996/2004] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:05 2022] DELETE /identity/v3/projects/f914e82002554d84bd9f3ae854c070ad => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:05.343584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.343878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.344159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.361889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:05.363023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.438605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1009/2005] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:05.440349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.440668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.441150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.463058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:05.469016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.479769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 997/2006] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:05.483996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.501677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3223-1296-42e8-95bf-4472b9258975 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.508126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.508948 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.509772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.509772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.510573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:05.510975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.512753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.532285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1010/2007] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:59:05.533710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.544240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2347e6-4405-47be-8d06-b1651c305ec0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.549710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.550532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.550961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.551317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.552159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.554527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.569296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.571831 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.587110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 998/2008] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:05 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:05.587252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7ff1-b3ff-413f-bdd3-1ac3abd3b2c8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.591123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.657464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.657873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a859e0-56d2-44c8-a7c7-7b573c1d8172 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.658238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.658527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.658799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] PATH_INFO: `/v3/projects/e422c1baeb8e4caba69ec02e7a9afb8b` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.659994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e422c1baeb8e4caba69ec02e7a9afb8b)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.661954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.662809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.663734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.664332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.664332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.665050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.667009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.691424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 999/2009] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:05 2022] POST /identity/v3/users => generated 279 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:05.695805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.705508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed19ea-ff4f-4af3-bc08-657c66031aec admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.710885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e422c1baeb8e4caba69ec02e7a9afb8b', 'request_id': 'req-7919aea9-3725-452e-857b-813479fa71f1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.716651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e422c1baeb8e4caba69ec02e7a9afb8b', 'request_id': 'req-7919aea9-3725-452e-857b-813479fa71f1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.723485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e422c1baeb8e4caba69ec02e7a9afb8b', 'request_id': 'req-7919aea9-3725-452e-857b-813479fa71f1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.736822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] The token cache is being invalidate because project e422c1baeb8e4caba69ec02e7a9afb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:05.736822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.737479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.739024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1011/2010] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:05 2022] DELETE /identity/v3/projects/e422c1baeb8e4caba69ec02e7a9afb8b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:05.742701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.744312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.766840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.767518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.767831 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.768109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.768837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.771210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.782613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1000/2011] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:05.786201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.788224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.801218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fa7-cb15-4a95-bef5-156e8f348af9 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.807358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.808281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.808566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.808848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.809640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.811293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.822662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1001/2012] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:05.828710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:05.840473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919aea9-3725-452e-857b-813479fa71f1 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.841584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154ab53-6b39-46ca-b3b4-87ce3a41230b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:05.845881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.846912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.847201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.847353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67049c2-7de0-45b5-aaeb-c443dee82e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:05.847503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] PATH_INFO: `/v3/users/07185b56b3bd42a9a66aeebd9d9b41ef` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.848545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67049c2-7de0-45b5-aaeb-c443dee82e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.848719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07185b56b3bd42a9a66aeebd9d9b41ef)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.848837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67049c2-7de0-45b5-aaeb-c443dee82e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.849307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67049c2-7de0-45b5-aaeb-c443dee82e81 admin admin] PATH_INFO: `/v3/projects/d397192809544b1198d230f4002b1c7a/users/60b23e7eff2243049bafd3f53e63af0d/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.851259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.866357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67049c2-7de0-45b5-aaeb-c443dee82e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d397192809544b1198d230f4002b1c7a, user_id=60b23e7eff2243049bafd3f53e63af0d, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:05.869900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67049c2-7de0-45b5-aaeb-c443dee82e81 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:05.886751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1002/2013] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:05 2022] PUT /identity/v3/projects/d397192809544b1198d230f4002b1c7a/users/60b23e7eff2243049bafd3f53e63af0d/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:05.898580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:05.898876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:05.899154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:05.915710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07185b56b3bd42a9a66aeebd9d9b41ef'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.916661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07185b56b3bd42a9a66aeebd9d9b41ef'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.928901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] MFA Rules not processed for user `60b23e7eff2243049bafd3f53e63af0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:05.930701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:05.935101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07185b56b3bd42a9a66aeebd9d9b41ef'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.944118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07185b56b3bd42a9a66aeebd9d9b41ef'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.945921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07185b56b3bd42a9a66aeebd9d9b41ef'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:05.962285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1012/2014] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:05 2022] DELETE /identity/v3/users/07185b56b3bd42a9a66aeebd9d9b41ef => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:06.035937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1003/2015] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:06.041702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.044230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.139207 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783148-f1e4-4c9a-ba85-6ad61e23b6b8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.144351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.145254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.145541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.145819 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.146515 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.148548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.186032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1013/2016] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/projects => generated 355 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:06.191364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.275728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98ff34-7b83-4169-a6fe-c8764e4d444a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.361324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.362244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.362488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.362769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.363581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.366435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.374000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.375824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.392127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44f992-8eb3-45db-b1f8-cdeaeabc5f1a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.401896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.402906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.403107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.403386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] PATH_INFO: `/v3/projects/3776c628284642868e9ee10f82166bdd` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.404988 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3776c628284642868e9ee10f82166bdd)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.409751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.443225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1004/2017] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:06.446695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.460748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f99b0-4b79-4d1e-862b-883961ef183c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.473817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.475066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.475875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.476667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.477866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.479311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.491729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1005/2018] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:06.494975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.500205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3776c628284642868e9ee10f82166bdd', 'request_id': 'req-8537b99f-ba0c-4690-be08-c114b1a85e3e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:06.509007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3776c628284642868e9ee10f82166bdd', 'request_id': 'req-8537b99f-ba0c-4690-be08-c114b1a85e3e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:06.511142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb371fe-02c9-4fc1-8a80-fbed164c6607 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.516667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3776c628284642868e9ee10f82166bdd', 'request_id': 'req-8537b99f-ba0c-4690-be08-c114b1a85e3e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:06.534012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] The token cache is being invalidate because project 3776c628284642868e9ee10f82166bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:06.534012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:06.534942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8537b99f-ba0c-4690-be08-c114b1a85e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:06.537123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1014/2019] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:06 2022] DELETE /identity/v3/projects/3776c628284642868e9ee10f82166bdd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:06.542723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea0f6-0ec9-404e-a38c-fa4c90eda4ee None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.543645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea0f6-0ec9-404e-a38c-fa4c90eda4ee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.543645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea0f6-0ec9-404e-a38c-fa4c90eda4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.563892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c28ea0f6-0ec9-404e-a38c-fa4c90eda4ee None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:06.565103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c28ea0f6-0ec9-404e-a38c-fa4c90eda4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.598472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.599377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.599690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.599972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] PATH_INFO: `/v3/projects/2c730ee3e9924969b48a13a7c8e51658/users/559dea3c991a4ecf992076777493e73a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.621743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c730ee3e9924969b48a13a7c8e51658, user_id=559dea3c991a4ecf992076777493e73a, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.624680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.641686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1006/2020] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:06 2022] PUT /identity/v3/projects/2c730ee3e9924969b48a13a7c8e51658/users/559dea3c991a4ecf992076777493e73a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:06.646234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.653282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1015/2021] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:06.655996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.656256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.656538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.659273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.684903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:06.686330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.734646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dacc3-978f-4df9-97e2-2e852c6afd47 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.739420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.740124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.740412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.740687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.741483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.743674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.748556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1016/2022] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:06.753283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.755572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1007/2023] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:06.758409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.766898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241992f-32d0-48e9-9495-41fc88ee2e5c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.768902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767cc1-f5ba-456c-8883-3e5496091c98 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.772040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.773573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.773860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.774132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.775074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:06.775218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.775752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762786d-8125-4c8c-b2c4-291e47c2efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.776843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762786d-8125-4c8c-b2c4-291e47c2efe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.777028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.777376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762786d-8125-4c8c-b2c4-291e47c2efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.777663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762786d-8125-4c8c-b2c4-291e47c2efe5 admin admin] PATH_INFO: `/v3/projects/2c730ee3e9924969b48a13a7c8e51658/users/559dea3c991a4ecf992076777493e73a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.780606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762786d-8125-4c8c-b2c4-291e47c2efe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c730ee3e9924969b48a13a7c8e51658, user_id=559dea3c991a4ecf992076777493e73a, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.784766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762786d-8125-4c8c-b2c4-291e47c2efe5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.796557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1017/2024] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:59:06.798559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1008/2025] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:06 2022] PUT /identity/v3/projects/2c730ee3e9924969b48a13a7c8e51658/users/559dea3c991a4ecf992076777493e73a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:06.801002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.809973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.810294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.810575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.811461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c80790-e1ef-4144-ab97-53eefd0c6618 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.836338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] MFA Rules not processed for user `559dea3c991a4ecf992076777493e73a`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:06.837531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.873928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.874591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.874870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.875140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.875882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.877793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.904839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1018/2026] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:06.908070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1009/2027] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:06.912484 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.919592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:06.922385 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:06.978728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824625f-9f36-415c-82f3-b6fc0cd7e876 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:06.983388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:06.984042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:06.984384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:06.984605 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:06.985271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:06.987179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:06.990090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c25eb-c34e-40c6-ab57-c502b6457a34 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.006598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1019/2028] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:06 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:07.011044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.020519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f0d74-40b7-41fd-a30c-f9d4686b6af8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.026679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.027335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.027645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.027925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.028683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.030303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.040242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1020/2029] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:07.044734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.045295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07ff82-4fd9-4696-8e78-8595c6a5269f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.045970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ff82-4fd9-4696-8e78-8595c6a5269f service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.046255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ff82-4fd9-4696-8e78-8595c6a5269f service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.046532 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07ff82-4fd9-4696-8e78-8595c6a5269f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.057144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519129e-805b-474a-8306-1f025b3c832a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.061839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.062514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.062801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.063081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.063874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.065477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.075992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1021/2030] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:07.080069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.089402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd27d4-ddaf-417b-ac01-c5e3714929c0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.094065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.094915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.095198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.095503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] PATH_INFO: `/v3/projects/2f44576ed2674838a56d54e02c7a3105/users/94dee1137ebe4dc8a89d71f1151fb722/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.106852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ff82-4fd9-4696-8e78-8595c6a5269f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.108319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07ff82-4fd9-4696-8e78-8595c6a5269f service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.110053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f44576ed2674838a56d54e02c7a3105, user_id=94dee1137ebe4dc8a89d71f1151fb722, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.112729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.118044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1010/2031] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:59:07.127386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1022/2032] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:07 2022] PUT /identity/v3/projects/2f44576ed2674838a56d54e02c7a3105/users/94dee1137ebe4dc8a89d71f1151fb722/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:07.139125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.139442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.139823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.167772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] MFA Rules not processed for user `94dee1137ebe4dc8a89d71f1151fb722`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:07.168966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:07.196370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.255803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1011/2033] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:07.259874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.262876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd43bf1-7634-44a6-9eb7-f866572068fa admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.268310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.269202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.269685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.270122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.276294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:07.328224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbf42a-1e7f-4bcc-a865-33beeb143fd5 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.332728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.333382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.333664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.333938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.334624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.337095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.339685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.341138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.349942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1023/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:59:07.363578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1012/2035] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:07 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:07.367728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.378419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3db23e-8d8b-4d36-ad09-cd6701f398a2 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.438444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.439075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.439358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.439670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.440364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.442295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.469232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1024/2036] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:07 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:07.473198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.486508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb18e00-6147-4d92-919c-6176bea246a7 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.496409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.497084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.497373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.497708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.498447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.500106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.511009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1013/2037] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:07.515219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.525787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa817da3-13e4-4d2e-8c5d-74a2886329a0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.530474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.531368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.531683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.531958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] PATH_INFO: `/v3/projects/ed15ac5022a0450cbbfa78e292caea5c/users/b5cf0297571c41f9bf2f3589eb5552e6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.549401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed15ac5022a0450cbbfa78e292caea5c, user_id=b5cf0297571c41f9bf2f3589eb5552e6, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.552182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.566609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1025/2038] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:07 2022] PUT /identity/v3/projects/ed15ac5022a0450cbbfa78e292caea5c/users/b5cf0297571c41f9bf2f3589eb5552e6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:07.571244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.581123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7479fb-501b-462f-b2c0-bad08063dfce admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.644381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2665c-0394-48bf-8f8e-c9ca5aad6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.645072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2665c-0394-48bf-8f8e-c9ca5aad6425 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.645355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2665c-0394-48bf-8f8e-c9ca5aad6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.645636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2665c-0394-48bf-8f8e-c9ca5aad6425 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.646374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2665c-0394-48bf-8f8e-c9ca5aad6425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.648063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2665c-0394-48bf-8f8e-c9ca5aad6425 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.657366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1014/2039] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:07.661527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.672266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756b7f5-6184-4018-9e85-814737ccd1fd admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.676914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.677814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.678120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.678650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] PATH_INFO: `/v3/projects/ed15ac5022a0450cbbfa78e292caea5c/users/b5cf0297571c41f9bf2f3589eb5552e6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.681200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed15ac5022a0450cbbfa78e292caea5c, user_id=b5cf0297571c41f9bf2f3589eb5552e6, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.683936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.693978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1026/2040] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:07 2022] PUT /identity/v3/projects/ed15ac5022a0450cbbfa78e292caea5c/users/b5cf0297571c41f9bf2f3589eb5552e6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:07.704192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.704492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.704781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.735071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] MFA Rules not processed for user `b5cf0297571c41f9bf2f3589eb5552e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:07.736321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:07.816499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1015/2041] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:07.827457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:07.829401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:07.889688 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfceff2-4efe-426a-8ee4-34ec7ccadf81 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:07.893394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7607201-e09b-4488-a097-c7b808d437c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:07.894046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7607201-e09b-4488-a097-c7b808d437c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:07.894334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7607201-e09b-4488-a097-c7b808d437c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:07.894663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7607201-e09b-4488-a097-c7b808d437c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:07.904404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7607201-e09b-4488-a097-c7b808d437c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:07.906860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7607201-e09b-4488-a097-c7b808d437c9 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:07.916790 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1027/2042] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:08.004605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:08.011516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616422a-61ce-4fe8-bb86-fe908f4b5878 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:08.015071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:08.015751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:08.016035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:08.016308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:08.073074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:08.074519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:08.083838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1016/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:11.038200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:11.038739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:11.038882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:11.057577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] MFA Rules not processed for user `7e296a6f0b144cc98812f26bf1f6a6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:11.058788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:11.115336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1028/2044] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:13.097140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:13.098624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:13.161650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86413e7-9fc8-4133-9efb-682ce5b3e012 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:13.166109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:13.166969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:13.167252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:13.167548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] PATH_INFO: `/v3/users/13f7154f3331436a9b5fdbb8c1600a6b` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:13.168717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f7154f3331436a9b5fdbb8c1600a6b)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:13.170638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:13.213250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f7154f3331436a9b5fdbb8c1600a6b'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.220318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f7154f3331436a9b5fdbb8c1600a6b'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.231947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f7154f3331436a9b5fdbb8c1600a6b'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.232570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f7154f3331436a9b5fdbb8c1600a6b'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.239120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f7154f3331436a9b5fdbb8c1600a6b'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.245552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1017/2045] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:13 2022] DELETE /identity/v3/users/13f7154f3331436a9b5fdbb8c1600a6b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:13.415778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:13.434263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3f52d-16c2-40bd-a09a-432cacc66606 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:13.490322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:13.491386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:13.491772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:13.492058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] PATH_INFO: `/v3/projects/4c4730ff98d245029d3d358ba9ed29d4` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:13.493241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4730ff98d245029d3d358ba9ed29d4)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:13.495156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:13.539372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4730ff98d245029d3d358ba9ed29d4', 'request_id': 'req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.545210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4730ff98d245029d3d358ba9ed29d4', 'request_id': 'req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.550342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4730ff98d245029d3d358ba9ed29d4', 'request_id': 'req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.562152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] The token cache is being invalidate because project 4c4730ff98d245029d3d358ba9ed29d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:13.562450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.563073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.565041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1029/2046] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:13 2022] DELETE /identity/v3/projects/4c4730ff98d245029d3d358ba9ed29d4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:13.568873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:13.570250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:13.583196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4786c-5b00-493c-8525-e2943b1a3cce admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:13.641204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:13.641993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:13.642282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:13.642559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] PATH_INFO: `/v3/users/237f99144aa04990914d085eab35f712` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:13.643761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237f99144aa04990914d085eab35f712)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:13.645699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:13.693357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237f99144aa04990914d085eab35f712'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.700714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237f99144aa04990914d085eab35f712'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.712760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237f99144aa04990914d085eab35f712'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.713416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237f99144aa04990914d085eab35f712'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.719926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237f99144aa04990914d085eab35f712'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:13.725605 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1018/2047] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:13 2022] DELETE /identity/v3/users/237f99144aa04990914d085eab35f712 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:13.896446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:13.899483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:13.921480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fecef-c1f4-4085-8fa9-37c5c21bdb5a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:13.980019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:13.980890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:13.981170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:13.981444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] PATH_INFO: `/v3/projects/316475acd4bc4b938ed58ed058bcecae` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:13.982619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=316475acd4bc4b938ed58ed058bcecae)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:13.984645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:14.030148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316475acd4bc4b938ed58ed058bcecae', 'request_id': 'req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:14.036330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316475acd4bc4b938ed58ed058bcecae', 'request_id': 'req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:14.041968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316475acd4bc4b938ed58ed058bcecae', 'request_id': 'req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:14.054994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] The token cache is being invalidate because project 316475acd4bc4b938ed58ed058bcecae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:14.055274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:14.055917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-63825f7a-fe7a-4eea-a2f3-63a05d7d8582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:14.057425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1030/2048] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:13 2022] DELETE /identity/v3/projects/316475acd4bc4b938ed58ed058bcecae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:21.500181 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:21.501734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:21.514702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d3d6-9621-41d5-81ba-d44be2623600 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:21.569027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:21.569885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:21.570168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:21.570440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] PATH_INFO: `/v3/users/94dee1137ebe4dc8a89d71f1151fb722` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:21.571629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dee1137ebe4dc8a89d71f1151fb722)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:21.573545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:21.618137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dee1137ebe4dc8a89d71f1151fb722'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:21.624480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dee1137ebe4dc8a89d71f1151fb722'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:21.636102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dee1137ebe4dc8a89d71f1151fb722'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:21.636760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dee1137ebe4dc8a89d71f1151fb722'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:21.643162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dee1137ebe4dc8a89d71f1151fb722'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:21.649017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1019/2049] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:21 2022] DELETE /identity/v3/users/94dee1137ebe4dc8a89d71f1151fb722 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:21.653481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:21.653989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:21.654322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:21.671719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:21.672970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:21.737754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1031/2050] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:21.748946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:21.750477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:21.805570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed017e0-5084-47b4-9748-62e061bf58ed admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:21.809241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:21.809888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:21.810176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:21.810460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:21.819953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:21.821378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:21.830553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1020/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:59:22.173780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:22.175579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:22.188906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd81bc-7d32-465a-a54f-154ab4f697e1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:22.195059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:22.196090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:22.196574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:22.197037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] PATH_INFO: `/v3/projects/2f44576ed2674838a56d54e02c7a3105` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:22.198465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f44576ed2674838a56d54e02c7a3105)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:22.200693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:22.251649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f44576ed2674838a56d54e02c7a3105', 'request_id': 'req-20546033-6a6e-457d-9b81-66bc860d4603'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.259167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f44576ed2674838a56d54e02c7a3105', 'request_id': 'req-20546033-6a6e-457d-9b81-66bc860d4603'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.265103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f44576ed2674838a56d54e02c7a3105', 'request_id': 'req-20546033-6a6e-457d-9b81-66bc860d4603'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.277106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] The token cache is being invalidate because project 2f44576ed2674838a56d54e02c7a3105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:22.277404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.278147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.279754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1032/2052] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:22 2022] DELETE /identity/v3/projects/2f44576ed2674838a56d54e02c7a3105 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:22.283727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:22.293640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa60cd-b9fa-4ce8-89df-58e44937cadf service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:22.353895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:22.354985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:22.355279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:22.355585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] PATH_INFO: `/v3/users/b5cf0297571c41f9bf2f3589eb5552e6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:22.356801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cf0297571c41f9bf2f3589eb5552e6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:22.358725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:22.413209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cf0297571c41f9bf2f3589eb5552e6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.419477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cf0297571c41f9bf2f3589eb5552e6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.431719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cf0297571c41f9bf2f3589eb5552e6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.432364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cf0297571c41f9bf2f3589eb5552e6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.438847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d7b06b04-c5fb-448c-b973-c76f87d98f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cf0297571c41f9bf2f3589eb5552e6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.445154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1021/2053] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:22 2022] DELETE /identity/v3/users/b5cf0297571c41f9bf2f3589eb5552e6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:22.706338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:22.707809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:22.722967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546033-6a6e-457d-9b81-66bc860d4603 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:22.784909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:22.785767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:22.786050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:22.786329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] PATH_INFO: `/v3/projects/ed15ac5022a0450cbbfa78e292caea5c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:22.788041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed15ac5022a0450cbbfa78e292caea5c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:22.789947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:22.833518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed15ac5022a0450cbbfa78e292caea5c', 'request_id': 'req-fd77d42d-22d2-4d92-8426-01d6594b7906'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.839256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed15ac5022a0450cbbfa78e292caea5c', 'request_id': 'req-fd77d42d-22d2-4d92-8426-01d6594b7906'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.844427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed15ac5022a0450cbbfa78e292caea5c', 'request_id': 'req-fd77d42d-22d2-4d92-8426-01d6594b7906'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.857286 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] The token cache is being invalidate because project ed15ac5022a0450cbbfa78e292caea5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:22.857590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.858230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fd77d42d-22d2-4d92-8426-01d6594b7906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:22.859792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1033/2054] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:22 2022] DELETE /identity/v3/projects/ed15ac5022a0450cbbfa78e292caea5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:22.864691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:22.865184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:22.865275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:22.883661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:22.884849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:22.941464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1022/2055] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:22.950695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:22.950920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:22.951194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:22.968844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:22.970003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:22.978213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1034/2056] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:22.982335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:22.991794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582f41d-574e-4bb5-a1f8-62666eb69e4b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:22.996361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:22.997009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:22.997319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:22.997600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:22.998324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:22.998635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.000287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.012091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1023/2057] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:59:23.016133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.025439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f98d-1ee0-4cad-a47a-f3a811b14f08 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.030092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.030738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.031023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.031298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.032037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.033939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.058576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1035/2058] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:23.062609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.072390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dadbc-a0f9-40de-aec1-c0eee9041b3c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.128114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.128667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.128955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.129355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.130072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.132077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.157438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1024/2059] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:23.158849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.174305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff17d-5077-4fa4-a86b-11375f17abf0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.179580 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.180503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.180790 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.181071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.181808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.183553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.195287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1036/2060] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:23.198958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.210428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574906-d934-4917-b05f-e7fec6eb4e0e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.215201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fad628-13cc-403d-babf-122841cdac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.216051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad628-13cc-403d-babf-122841cdac93 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.216446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad628-13cc-403d-babf-122841cdac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.216838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad628-13cc-403d-babf-122841cdac93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.217743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fad628-13cc-403d-babf-122841cdac93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.219571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fad628-13cc-403d-babf-122841cdac93 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.230629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1025/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:23.234486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.246640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd7fcc-400b-4560-885e-ddd7b0f1d0ef admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.251921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.252823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.253105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.253389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] PATH_INFO: `/v3/projects/5d11946b1e8842c7a55fa8a405aacdd6/users/8d4c23a606634f68bf2c35425351da27/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.275991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d11946b1e8842c7a55fa8a405aacdd6, user_id=8d4c23a606634f68bf2c35425351da27, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.278913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.295908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1037/2062] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:23 2022] PUT /identity/v3/projects/5d11946b1e8842c7a55fa8a405aacdd6/users/8d4c23a606634f68bf2c35425351da27/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:23.307340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.307340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.307638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.338130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] MFA Rules not processed for user `8d4c23a606634f68bf2c35425351da27`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:23.339371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:23.420540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1026/2063] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:23.422276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.503895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d781e-9f74-4ff1-bb32-d84c9d556dc7 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.509521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.510268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.510512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.511010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.512559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.514683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.539703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1038/2064] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:23.543731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.555180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543a7e2-84b5-4844-ac9a-fbe3fd17b031 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.611199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.611892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.612176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.612450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.613136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.615045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.634090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1027/2065] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:23.638268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.649037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10c98-eac2-40e3-abcc-8a91aeda398e admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.653655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.654300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.654585 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.654862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.655655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.657373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.671583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1039/2066] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:23.675473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.685588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f20c3-ecf5-4b00-ae6e-ca3bc3c5e491 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.690490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f2b4-0123-467a-a80f-d90b9d291da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.691271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f2b4-0123-467a-a80f-d90b9d291da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.691621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f2b4-0123-467a-a80f-d90b9d291da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.691911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f2b4-0123-467a-a80f-d90b9d291da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.692646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f2b4-0123-467a-a80f-d90b9d291da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.694912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f2b4-0123-467a-a80f-d90b9d291da4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.704969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1028/2067] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:23.709180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.722707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace63d7c-73f0-4beb-b37d-5adafb899323 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.727471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.728463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.728838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.729408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] PATH_INFO: `/v3/projects/98021827e5d94d2b8d69c77fb186b267/users/0617a508222445d39d8946723bba4e70/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.747494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98021827e5d94d2b8d69c77fb186b267, user_id=0617a508222445d39d8946723bba4e70, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.751139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.774543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1040/2068] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:23 2022] PUT /identity/v3/projects/98021827e5d94d2b8d69c77fb186b267/users/0617a508222445d39d8946723bba4e70/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:23.784682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.784975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.785258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.812702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] MFA Rules not processed for user `0617a508222445d39d8946723bba4e70`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:23.814009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:23.874434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1029/2069] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:23.878781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.937308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d69269-163c-4880-8765-b9bdb8e49b86 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:23.941907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:23.942555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:23.942839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:23.943115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:23.944030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:23.945928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:23.971212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1041/2070] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:23.975486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:23.986471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c6117-ea18-4df6-9f91-bf5c4f826d6e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.042740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.043408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.043738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.044017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.044708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.046619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.065239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1030/2071] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:23 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:24.069330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:24.079394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae60428-635c-4e11-9784-4d20572d2c35 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.083949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.085083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.085362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.085632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.086344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.087954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.098178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1042/2072] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:24.102032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:24.111577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615f71d-357a-4de2-89d2-7a235920a190 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.116826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.117682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.117964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.118240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] PATH_INFO: `/v3/projects/248743049ff9468cb742c22ff85765bc/users/e911a6fb24af49b7a13303feaef2afd8/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.132643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248743049ff9468cb742c22ff85765bc, user_id=e911a6fb24af49b7a13303feaef2afd8, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.136429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.150100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1031/2073] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:24 2022] PUT /identity/v3/projects/248743049ff9468cb742c22ff85765bc/users/e911a6fb24af49b7a13303feaef2afd8/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:24.153990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:24.164841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada0efe-eea1-4612-b0d5-118d9fea7246 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.218528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc0e7-3fe4-4f98-81d4-0552e2382d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.219194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc0e7-3fe4-4f98-81d4-0552e2382d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.219479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc0e7-3fe4-4f98-81d4-0552e2382d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.219784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc0e7-3fe4-4f98-81d4-0552e2382d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.220512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc0e7-3fe4-4f98-81d4-0552e2382d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.222121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc0e7-3fe4-4f98-81d4-0552e2382d49 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.232822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1043/2074] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:24.236910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:24.246825 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b09b73-09b4-4d13-9414-d20d3de65039 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.251745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.252637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.252925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.253208 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] PATH_INFO: `/v3/projects/248743049ff9468cb742c22ff85765bc/users/e911a6fb24af49b7a13303feaef2afd8/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.255238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=248743049ff9468cb742c22ff85765bc, user_id=e911a6fb24af49b7a13303feaef2afd8, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.258496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.269082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1032/2075] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:24 2022] PUT /identity/v3/projects/248743049ff9468cb742c22ff85765bc/users/e911a6fb24af49b7a13303feaef2afd8/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:24.280182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.280474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.280753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.315919 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] MFA Rules not processed for user `e911a6fb24af49b7a13303feaef2afd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:24.317094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:24.384613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1044/2076] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:24.395815 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:24.397575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:24.452805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44081abc-71f5-4a8b-a364-1880b74c7ead admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.456486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.457128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.457412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.457687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.466747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.468297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.478162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1033/2077] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:24.522363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:24.532950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1e480-5786-4b7e-9a79-150418df3ba8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:24.536321 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0186-8e37-48e5-bae5-ef394ecf772a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:24.536975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0186-8e37-48e5-bae5-ef394ecf772a service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:24.537260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0186-8e37-48e5-bae5-ef394ecf772a service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:24.538061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0186-8e37-48e5-bae5-ef394ecf772a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:24.600322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a0186-8e37-48e5-bae5-ef394ecf772a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:24.601963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a0186-8e37-48e5-bae5-ef394ecf772a service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:24.611538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1045/2078] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:27.551128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:27.624437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70236663-9545-4be2-9d67-5bc3374e5f1f service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:27.629078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:27.629978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:27.630254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:27.630522 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] PATH_INFO: `/v3/users/8d4c23a606634f68bf2c35425351da27` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:27.631957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4c23a606634f68bf2c35425351da27)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:27.633900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:27.679125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4c23a606634f68bf2c35425351da27'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:27.685798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4c23a606634f68bf2c35425351da27'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:27.696965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4c23a606634f68bf2c35425351da27'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:27.697674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4c23a606634f68bf2c35425351da27'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:27.704378 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4c23a606634f68bf2c35425351da27'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:27.710661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1034/2079] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:27 2022] DELETE /identity/v3/users/8d4c23a606634f68bf2c35425351da27 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:27.715183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:27.715716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:27.715829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:27.732854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:27.734097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:27.797807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1046/2080] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:27.808373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:27.809768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:27.866920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124a6d2-7465-4f9f-99d9-acc396804c62 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:27.870510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:27.871152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:27.871437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:27.871758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:27.880645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:27.882669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:27.892000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1035/2081] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:28.149121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:28.152392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:28.164860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ca1a6-ec69-4bec-86f5-584f17de1fa7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:28.170899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:28.171804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:28.172098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:28.172358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] PATH_INFO: `/v3/projects/5d11946b1e8842c7a55fa8a405aacdd6` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:28.173567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d11946b1e8842c7a55fa8a405aacdd6)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:28.175602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:28.223554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d11946b1e8842c7a55fa8a405aacdd6', 'request_id': 'req-6db6c131-0d5c-46ec-b1f7-5158c730bafb'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.230203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d11946b1e8842c7a55fa8a405aacdd6', 'request_id': 'req-6db6c131-0d5c-46ec-b1f7-5158c730bafb'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.235849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d11946b1e8842c7a55fa8a405aacdd6', 'request_id': 'req-6db6c131-0d5c-46ec-b1f7-5158c730bafb'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.249357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] The token cache is being invalidate because project 5d11946b1e8842c7a55fa8a405aacdd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:28.249725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.250576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.252192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1047/2082] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:28 2022] DELETE /identity/v3/projects/5d11946b1e8842c7a55fa8a405aacdd6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:28.256705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:28.266474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8025e51-d833-4af6-a89b-6dd9b91b8c23 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:28.321681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:28.322541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:28.322824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:28.323097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] PATH_INFO: `/v3/users/0617a508222445d39d8946723bba4e70` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:28.324292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0617a508222445d39d8946723bba4e70)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:28.326188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:28.369757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0617a508222445d39d8946723bba4e70'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.376416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0617a508222445d39d8946723bba4e70'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.388013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0617a508222445d39d8946723bba4e70'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.388642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0617a508222445d39d8946723bba4e70'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.395066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0617a508222445d39d8946723bba4e70'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.400748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1036/2083] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:28 2022] DELETE /identity/v3/users/0617a508222445d39d8946723bba4e70 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:28.762498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:28.764062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:28.786297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6c131-0d5c-46ec-b1f7-5158c730bafb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:28.848111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:28.849400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:28.850285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:28.850592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] PATH_INFO: `/v3/projects/98021827e5d94d2b8d69c77fb186b267` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:28.851855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98021827e5d94d2b8d69c77fb186b267)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:28.853843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:28.907706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:28.908168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98021827e5d94d2b8d69c77fb186b267', 'request_id': 'req-3fc59eb1-2070-429b-bcaa-12f6d66acac0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.909363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:28.916900 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98021827e5d94d2b8d69c77fb186b267', 'request_id': 'req-3fc59eb1-2070-429b-bcaa-12f6d66acac0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.923175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c1bfe-d952-4744-b268-a4743bb591c0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:28.923451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98021827e5d94d2b8d69c77fb186b267', 'request_id': 'req-3fc59eb1-2070-429b-bcaa-12f6d66acac0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.937746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] The token cache is being invalidate because project 98021827e5d94d2b8d69c77fb186b267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:28.938037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.938663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:28.940395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1048/2084] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:28 2022] DELETE /identity/v3/projects/98021827e5d94d2b8d69c77fb186b267 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:28.944372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:28.945767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:28.981268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:28.982139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:28.982420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:28.982714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] PATH_INFO: `/v3/users/60b23e7eff2243049bafd3f53e63af0d` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:28.983900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b23e7eff2243049bafd3f53e63af0d)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:28.986630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.007265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59eb1-2070-429b-bcaa-12f6d66acac0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.011941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.013268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.013711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.014083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] PATH_INFO: `/v3/users/e911a6fb24af49b7a13303feaef2afd8` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.015441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e911a6fb24af49b7a13303feaef2afd8)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.017871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.043402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b23e7eff2243049bafd3f53e63af0d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.053440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b23e7eff2243049bafd3f53e63af0d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.065935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b23e7eff2243049bafd3f53e63af0d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.066590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b23e7eff2243049bafd3f53e63af0d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.070299 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e911a6fb24af49b7a13303feaef2afd8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.070955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e911a6fb24af49b7a13303feaef2afd8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.073493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00d6e508-49b4-4846-a60e-6ebdaae35e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b23e7eff2243049bafd3f53e63af0d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.079182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1037/2085] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:28 2022] DELETE /identity/v3/users/60b23e7eff2243049bafd3f53e63af0d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:29.082723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e911a6fb24af49b7a13303feaef2afd8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.083422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.083763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.084821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.092674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e911a6fb24af49b7a13303feaef2afd8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.093254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e911a6fb24af49b7a13303feaef2afd8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.102794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:29.104104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.106436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1049/2086] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:28 2022] DELETE /identity/v3/users/e911a6fb24af49b7a13303feaef2afd8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:29.165093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1038/2087] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:29.176077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.178061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.239635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca585b-5e9d-445d-b36f-e4689635c757 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.244878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3323d-8cdf-40a2-a707-c160f33bde1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.245660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3323d-8cdf-40a2-a707-c160f33bde1e service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.247349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3323d-8cdf-40a2-a707-c160f33bde1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.247349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3323d-8cdf-40a2-a707-c160f33bde1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.256782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3323d-8cdf-40a2-a707-c160f33bde1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.258292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3323d-8cdf-40a2-a707-c160f33bde1e service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.268618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1050/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:29.497078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.498513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.510908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2b8ae-4703-4b27-b7ba-bb8d8dc92c57 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.516077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.517188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.517618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.518062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] PATH_INFO: `/v3/projects/248743049ff9468cb742c22ff85765bc` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.519686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=248743049ff9468cb742c22ff85765bc)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.522613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.571573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248743049ff9468cb742c22ff85765bc', 'request_id': 'req-20a3468f-fce2-412e-a542-6d7b97a941cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.578819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248743049ff9468cb742c22ff85765bc', 'request_id': 'req-20a3468f-fce2-412e-a542-6d7b97a941cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.584994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248743049ff9468cb742c22ff85765bc', 'request_id': 'req-20a3468f-fce2-412e-a542-6d7b97a941cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.596584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] The token cache is being invalidate because project 248743049ff9468cb742c22ff85765bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:29.596960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.597664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.600372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1039/2089] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:29 2022] DELETE /identity/v3/projects/248743049ff9468cb742c22ff85765bc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:29.607036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858739c-903f-4cab-a13d-7909e41dcd02 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.607331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858739c-903f-4cab-a13d-7909e41dcd02 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.607705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858739c-903f-4cab-a13d-7909e41dcd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.610000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.611508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.631582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9858739c-903f-4cab-a13d-7909e41dcd02 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:29.635934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9858739c-903f-4cab-a13d-7909e41dcd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.693897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3468f-fce2-412e-a542-6d7b97a941cf admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.700575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.701492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.701724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.702002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] PATH_INFO: `/v3/projects/d397192809544b1198d230f4002b1c7a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.703183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d397192809544b1198d230f4002b1c7a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.706059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1051/2090] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:29.706412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.717276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.717923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.718428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.753292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:29.754511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.774517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd397192809544b1198d230f4002b1c7a', 'request_id': 'req-73f3a378-1090-448f-b3df-5782d3896685'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.784513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd397192809544b1198d230f4002b1c7a', 'request_id': 'req-73f3a378-1090-448f-b3df-5782d3896685'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.793830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd397192809544b1198d230f4002b1c7a', 'request_id': 'req-73f3a378-1090-448f-b3df-5782d3896685'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.809846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] The token cache is being invalidate because project d397192809544b1198d230f4002b1c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:29.811023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.811023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.816774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1040/2091] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:29 2022] DELETE /identity/v3/projects/d397192809544b1198d230f4002b1c7a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:29.817804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.820150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:29.843048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1052/2092] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:29.847874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.858975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf8fc9-eaa9-48b7-bad8-99693f614433 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.871283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.872151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.872537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.872911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.874814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:29.874941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.877262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.898177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a378-1090-448f-b3df-5782d3896685 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.903342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.904330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.904554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.904830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] PATH_INFO: `/v3/users/559dea3c991a4ecf992076777493e73a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.906080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559dea3c991a4ecf992076777493e73a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.908086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.908737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1053/2093] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:59:29.918862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.931703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9ef62-e1fc-48cd-9343-b755f11418ba admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:29.942873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:29.943893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:29.944041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:29.944320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:29.945007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:29.946906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:29.970743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559dea3c991a4ecf992076777493e73a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.978971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1054/2094] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:29 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:29.983287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:29.983453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559dea3c991a4ecf992076777493e73a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.998285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559dea3c991a4ecf992076777493e73a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:29.999271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559dea3c991a4ecf992076777493e73a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.018227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559dea3c991a4ecf992076777493e73a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.032683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1041/2095] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:29 2022] DELETE /identity/v3/users/559dea3c991a4ecf992076777493e73a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:30.084650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d30d3-d4b0-4b6e-ac6e-32155022ad7c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.166834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.167723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.168016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.168350 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.169140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.171712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.201448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1055/2096] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:29 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:30.202807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.204242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.222019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4e82-8742-4d5a-882e-09bbfd98d131 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.256866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.257565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.257850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.258125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.258870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.260731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.278981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1042/2097] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:30.280104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.294780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5e4a9-879a-4543-9a89-143dd5d28ec7 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.306761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066915c5-e94c-4f2a-bcfe-617b9e671baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.308582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066915c5-e94c-4f2a-bcfe-617b9e671baf admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.308891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066915c5-e94c-4f2a-bcfe-617b9e671baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.310038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066915c5-e94c-4f2a-bcfe-617b9e671baf admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.310870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066915c5-e94c-4f2a-bcfe-617b9e671baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.316075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066915c5-e94c-4f2a-bcfe-617b9e671baf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.335683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1056/2098] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:30.339372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.350201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32ec28-76e3-4ff5-a1a0-642183beadcb admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.356002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.356984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.357246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.357519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] PATH_INFO: `/v3/projects/ffc0ea2a5dac43af8baaafc09565508e/users/bdff5c66374644a9925deac42e11fdd3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.374348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc0ea2a5dac43af8baaafc09565508e, user_id=bdff5c66374644a9925deac42e11fdd3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.377101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.392361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1043/2099] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:30 2022] PUT /identity/v3/projects/ffc0ea2a5dac43af8baaafc09565508e/users/bdff5c66374644a9925deac42e11fdd3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:30.406005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.406378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.407570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.410421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.412328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.438892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] MFA Rules not processed for user `bdff5c66374644a9925deac42e11fdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:30.440240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.482356 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e7c5-1608-46b6-bb7d-544aa383d003 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.487169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.488128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.488430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.488690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] PATH_INFO: `/v3/projects/2c730ee3e9924969b48a13a7c8e51658` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.489891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c730ee3e9924969b48a13a7c8e51658)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.491901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.503962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1057/2100] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:30.508552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.518814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc51b1b-785e-4c44-ba03-b5b91aa137ef None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.524373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.524960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.525241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.525547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.526237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.528243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.537884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c730ee3e9924969b48a13a7c8e51658', 'request_id': 'req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.545157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c730ee3e9924969b48a13a7c8e51658', 'request_id': 'req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.550399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c730ee3e9924969b48a13a7c8e51658', 'request_id': 'req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.553337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1058/2101] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:30.557314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.564933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] The token cache is being invalidate because project 2c730ee3e9924969b48a13a7c8e51658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:30.565235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.565882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d856380f-76c3-4f1a-bddb-fd9eaaf29f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:30.567426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1044/2102] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:30 2022] DELETE /identity/v3/projects/2c730ee3e9924969b48a13a7c8e51658 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:30.572011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb68d3-8bb8-4457-b40c-613be6b71f96 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.572298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb68d3-8bb8-4457-b40c-613be6b71f96 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.572589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb68d3-8bb8-4457-b40c-613be6b71f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.592096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-30bb68d3-8bb8-4457-b40c-613be6b71f96 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:30.593419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-30bb68d3-8bb8-4457-b40c-613be6b71f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.618837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674531-c7c8-4bb5-975a-95f08c95420b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.623869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.624566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.624856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.625137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.625823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.627794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.646191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1059/2103] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:30.650512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.651550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1045/2104] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:30.652104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.659059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.659346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.659652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.664268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005f3e8-87e1-44ce-94f9-6e1744031453 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.668940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.669588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.669875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.670156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.670881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.672522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.676652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:30.678584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.682870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1060/2105] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:30.686771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.687046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1046/2106] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:30.690881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.697249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d65a9f-17d5-4847-8446-da93eaf2bdfb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.699778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d913e49-ff65-4bab-a1ae-419557df3210 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.701933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.702874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.703159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.703438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] PATH_INFO: `/v3/projects/13abad7a90c44e8ca9ac35dc407af8b1/users/8341c45607854ab79d15f200d5c50667/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.704626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.705259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.705551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.705827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.706571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:30.706881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.708514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.718634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13abad7a90c44e8ca9ac35dc407af8b1, user_id=8341c45607854ab79d15f200d5c50667, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.720229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1047/2107] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:59:30.724506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.724741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.734081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f318ad-5cf0-408a-8fea-87d31802339c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.737278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1061/2108] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:30 2022] PUT /identity/v3/projects/13abad7a90c44e8ca9ac35dc407af8b1/users/8341c45607854ab79d15f200d5c50667/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:30.741752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.793588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.794168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.794455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.794731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.795424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.797348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.802091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3dc16-a849-4377-821e-3a5209fd9475 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.807889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.808542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.808824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.809098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.809817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.811424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.821197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1062/2109] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:30.823557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1048/2110] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:30.825307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.827147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.835710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014910e4-de13-462d-b2b3-122f80262774 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.885213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364626b8-52c1-42d9-ada2-78038edded4a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.888615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d0c1-f5f2-4ca2-966a-4052332940e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.889495 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d0c1-f5f2-4ca2-966a-4052332940e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.889778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d0c1-f5f2-4ca2-966a-4052332940e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.890055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d0c1-f5f2-4ca2-966a-4052332940e0 admin admin] PATH_INFO: `/v3/projects/13abad7a90c44e8ca9ac35dc407af8b1/users/8341c45607854ab79d15f200d5c50667/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.890435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.891103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.891392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.891707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.892049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d0c1-f5f2-4ca2-966a-4052332940e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13abad7a90c44e8ca9ac35dc407af8b1, user_id=8341c45607854ab79d15f200d5c50667, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.892394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.894336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.894723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87d0c1-f5f2-4ca2-966a-4052332940e0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:30.905149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1063/2111] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:30 2022] PUT /identity/v3/projects/13abad7a90c44e8ca9ac35dc407af8b1/users/8341c45607854ab79d15f200d5c50667/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:30.914373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1049/2112] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:30.916108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.916401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.916682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.918290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:30.928004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384a235-a8b1-47fb-9c1a-11921a318676 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:30.943744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] MFA Rules not processed for user `8341c45607854ab79d15f200d5c50667`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:30.947984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:30.993991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:30.994697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:30.994984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:30.995261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:30.996070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:30.997794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.011480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1050/2113] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:31.016583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.029770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061c99c-bed2-4a33-a0cd-b2016d002b00 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.035699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.036951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.037461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.040009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.040954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.042736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1064/2114] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:31.042866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.054285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1051/2115] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:31.057236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.058726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:31.058891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.071508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290641-bea1-4385-8a60-793ccfb362eb admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.076750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31e1e2-01d8-441e-a5f0-488b644612f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.077639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e1e2-01d8-441e-a5f0-488b644612f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.077926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e1e2-01d8-441e-a5f0-488b644612f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.078360 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31e1e2-01d8-441e-a5f0-488b644612f0 admin admin] PATH_INFO: `/v3/projects/4176f1d55f504fe09b7d8e1dff0dbf33/users/7aada3b29375458f87c7fa6a4c98a324/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.097808 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31e1e2-01d8-441e-a5f0-488b644612f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4176f1d55f504fe09b7d8e1dff0dbf33, user_id=7aada3b29375458f87c7fa6a4c98a324, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.100589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31e1e2-01d8-441e-a5f0-488b644612f0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.113798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1052/2116] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:31 2022] PUT /identity/v3/projects/4176f1d55f504fe09b7d8e1dff0dbf33/users/7aada3b29375458f87c7fa6a4c98a324/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:31.120696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6e4f0-a803-468d-970d-7ae5f8de9692 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.125676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.126018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.126303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.153843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] MFA Rules not processed for user `7aada3b29375458f87c7fa6a4c98a324`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:31.155043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:31.167745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.168395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.168678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.168984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.221150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1053/2117] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:31.226423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.234328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.236214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.246553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1065/2118] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:31.293355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4390c-c926-4fd4-9e33-d46fb6cbfc54 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.297976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.298575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.298862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.299139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.299864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.301782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.330655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1054/2119] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:31 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:31.331873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.333131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.345225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfff86-2c4e-48bf-a3ce-6fc66070e2b3 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.388914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdc507-9bec-48c6-aca6-45bcd9976581 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.393154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.393800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.394104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.394352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.400298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:31.437441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.438741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.439233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.439683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.440542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.444721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.472974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1066/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:31 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:31.477460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.479468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.481340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.493144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1055/2121] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:59:31.497840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32262999-f552-4fb4-8b55-62b57ec9e96f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.509606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.510355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.510941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.511198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.512072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.513851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.530934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1067/2122] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:31.532219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.545397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b64a-58b9-4fa6-9baf-3203cbe38504 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.550893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.551845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.552187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.553739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] PATH_INFO: `/v3/projects/3bd791abfc4e43459425e98f79bb813d/users/013505f7b213454c88811ef229ad5c60/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.589157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd791abfc4e43459425e98f79bb813d, user_id=013505f7b213454c88811ef229ad5c60, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.592108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.606383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1056/2123] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:31 2022] PUT /identity/v3/projects/3bd791abfc4e43459425e98f79bb813d/users/013505f7b213454c88811ef229ad5c60/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:31.610193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.622116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e706b-f601-4155-a52a-88f8247f7a67 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.687332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822432b-e0b8-4e02-aa19-3150bdcca94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.688197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822432b-e0b8-4e02-aa19-3150bdcca94e admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.688666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822432b-e0b8-4e02-aa19-3150bdcca94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.689061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822432b-e0b8-4e02-aa19-3150bdcca94e admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.689930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822432b-e0b8-4e02-aa19-3150bdcca94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.691746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822432b-e0b8-4e02-aa19-3150bdcca94e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.705753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1068/2124] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:31.710337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.721116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554f7b8-af43-4ceb-877a-18a3bf68524d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.726879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.727986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.728264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.728514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] PATH_INFO: `/v3/projects/3bd791abfc4e43459425e98f79bb813d/users/013505f7b213454c88811ef229ad5c60/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.730682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd791abfc4e43459425e98f79bb813d, user_id=013505f7b213454c88811ef229ad5c60, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.734215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:31.758154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1057/2125] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:31 2022] PUT /identity/v3/projects/3bd791abfc4e43459425e98f79bb813d/users/013505f7b213454c88811ef229ad5c60/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:31.769296 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.770799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.771960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.805049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] MFA Rules not processed for user `013505f7b213454c88811ef229ad5c60`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:31.807863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:31.907372 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1069/2126] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:31.921330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:31.978689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc809-9bd3-4863-bde2-75e61dde1dd0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:31.982637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:31.983290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:31.983602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:31.983886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:31.994633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:31.996310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:32.007370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1058/2127] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:32.123820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:32.125415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.130059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:32.132092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.144952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59bf7-8dcc-4979-a0f2-b5333d0536bd service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:32.149571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5992f0a-0bcd-4abd-8bff-876b956fce41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:32.150699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992f0a-0bcd-4abd-8bff-876b956fce41 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.150994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992f0a-0bcd-4abd-8bff-876b956fce41 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.151273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5992f0a-0bcd-4abd-8bff-876b956fce41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.220448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32d65a-8c3d-49c9-a048-53e4f574026a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:32.226508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:32.228821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.229173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.229519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] PATH_INFO: `/v3/users/fb2fdc46e2dd48e3b338f5fb012ebea6` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.230819 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2fdc46e2dd48e3b338f5fb012ebea6)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:32.233425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5992f0a-0bcd-4abd-8bff-876b956fce41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:32.233881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:32.235227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5992f0a-0bcd-4abd-8bff-876b956fce41 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:32.248572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1059/2128] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:32.311231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2fdc46e2dd48e3b338f5fb012ebea6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.312103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2fdc46e2dd48e3b338f5fb012ebea6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.332083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2fdc46e2dd48e3b338f5fb012ebea6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.343160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2fdc46e2dd48e3b338f5fb012ebea6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.344338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2fdc46e2dd48e3b338f5fb012ebea6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.360382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1070/2129] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:32 2022] DELETE /identity/v3/users/fb2fdc46e2dd48e3b338f5fb012ebea6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:32.365781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.366140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.366484 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.384673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:32.386114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.500335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1060/2130] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:32.507974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:32.510624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.611698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:32.612192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928baed-92af-4e83-a5bf-69ff118e7103 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:32.615028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.618985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cf6db-7f2b-42ba-9e08-f222d726c9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:32.619854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf6db-7f2b-42ba-9e08-f222d726c9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.620215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf6db-7f2b-42ba-9e08-f222d726c9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.621042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cf6db-7f2b-42ba-9e08-f222d726c9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.630213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514e249-e166-4df3-901d-0694dc6453a7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:32.635149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cf6db-7f2b-42ba-9e08-f222d726c9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:32.638828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cf6db-7f2b-42ba-9e08-f222d726c9e6 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:32.646757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:32.648279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.648563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.648848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] PATH_INFO: `/v3/users/7aada3b29375458f87c7fa6a4c98a324` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.650755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aada3b29375458f87c7fa6a4c98a324)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:32.655101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:32.656697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1071/2131] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:32.727762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aada3b29375458f87c7fa6a4c98a324'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.742603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aada3b29375458f87c7fa6a4c98a324'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.770990 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aada3b29375458f87c7fa6a4c98a324'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.772738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aada3b29375458f87c7fa6a4c98a324'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.780794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aada3b29375458f87c7fa6a4c98a324'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:32.788843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1061/2132] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:32 2022] DELETE /identity/v3/users/7aada3b29375458f87c7fa6a4c98a324 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:32.793920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.794212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.794492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.815462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:32.817117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.885764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1072/2133] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:32.896640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:32.898145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:32.969786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ddc32-18e6-45e1-aefa-be7082b7bb45 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:32.975618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16774e-ee94-4772-b612-6ee38c5e8d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:32.976714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16774e-ee94-4772-b612-6ee38c5e8d39 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:32.977005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16774e-ee94-4772-b612-6ee38c5e8d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:32.977714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16774e-ee94-4772-b612-6ee38c5e8d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:32.990634 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16774e-ee94-4772-b612-6ee38c5e8d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:32.993038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16774e-ee94-4772-b612-6ee38c5e8d39 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.016886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1062/2134] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:33.131111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.133209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.155147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad988e0-859e-4f6b-bf43-d0f40380c645 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.161616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.163165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.163612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.163997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] PATH_INFO: `/v3/projects/978bdb97dca745229c91529235d8476c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.165423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978bdb97dca745229c91529235d8476c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.168597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.241443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978bdb97dca745229c91529235d8476c', 'request_id': 'req-3688df73-5a3a-45a7-9549-769b23ef7877'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.248393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978bdb97dca745229c91529235d8476c', 'request_id': 'req-3688df73-5a3a-45a7-9549-769b23ef7877'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.260332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978bdb97dca745229c91529235d8476c', 'request_id': 'req-3688df73-5a3a-45a7-9549-769b23ef7877'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.276084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] The token cache is being invalidate because project 978bdb97dca745229c91529235d8476c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:33.276084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.276847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.278631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1073/2135] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:33 2022] DELETE /identity/v3/projects/978bdb97dca745229c91529235d8476c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:33.283406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c87b-9a82-47b8-871e-f9c965de6291 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.283724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c87b-9a82-47b8-871e-f9c965de6291 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.284012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c87b-9a82-47b8-871e-f9c965de6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.305643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2595c87b-9a82-47b8-871e-f9c965de6291 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:33.306889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2595c87b-9a82-47b8-871e-f9c965de6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.371467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.372910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.384787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1063/2136] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:33.386969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.387303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.387651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.402701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688df73-5a3a-45a7-9549-769b23ef7877 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.408038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.408961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.409257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.409538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] PATH_INFO: `/v3/projects/4176f1d55f504fe09b7d8e1dff0dbf33` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.410833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4176f1d55f504fe09b7d8e1dff0dbf33)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.413544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.415982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:33.418450 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.432720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1064/2137] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:33.439906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.450198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fe7bb-4a09-4413-9fa6-22dfdbee5dc7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.455550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.456256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.456785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.456926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.457578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:33.457895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.459624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7d491-69d9-42fa-b316-bd0eff2757bc admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.471375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4176f1d55f504fe09b7d8e1dff0dbf33', 'request_id': 'req-91a04ab6-92bc-4508-bcce-63a2c6741971'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.471573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1065/2138] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:59:33.472736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.473026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.473308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.481843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4176f1d55f504fe09b7d8e1dff0dbf33', 'request_id': 'req-91a04ab6-92bc-4508-bcce-63a2c6741971'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.487472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4176f1d55f504fe09b7d8e1dff0dbf33', 'request_id': 'req-91a04ab6-92bc-4508-bcce-63a2c6741971'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.490716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] MFA Rules not processed for user `6ecde8d802f04ab7bde761e9a0e6b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:33.491988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.499897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] The token cache is being invalidate because project 4176f1d55f504fe09b7d8e1dff0dbf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:33.500184 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.500816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.502365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1074/2139] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:33 2022] DELETE /identity/v3/projects/4176f1d55f504fe09b7d8e1dff0dbf33 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:33.503104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.506905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.546304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1066/2140] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:33.547508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.548796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.574441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a04ab6-92bc-4508-bcce-63a2c6741971 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.582699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.583415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.584262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.584546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.585248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.587162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.621282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1075/2141] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:33 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:33.622711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.626544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150771cf-0356-471a-8f8b-b34a7a6fcc71 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.684959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.685838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.686124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.686400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] PATH_INFO: `/v3/users/013505f7b213454c88811ef229ad5c60` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.686790 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a1a21-3575-4328-9db3-1cda773ef205 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.687656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013505f7b213454c88811ef229ad5c60)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.689716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.693516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.694194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.694483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.694765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.695462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.697428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.722786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1076/2142] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:33 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:33.726799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.737118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d034d-2a56-454e-b11e-e7b10d94544c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.743351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.743543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013505f7b213454c88811ef229ad5c60'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.744046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.744334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.744615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.745354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.747026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.760812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013505f7b213454c88811ef229ad5c60'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.764532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1077/2143] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:33.766717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.777269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013505f7b213454c88811ef229ad5c60'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.779731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013505f7b213454c88811ef229ad5c60'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.781412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054b73-b2c0-4077-9b7b-c8e51d8a1a2b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.790654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013505f7b213454c88811ef229ad5c60'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:33.791386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa46b-e473-4fc9-9eb0-e63da31431e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.792163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa46b-e473-4fc9-9eb0-e63da31431e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.792510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa46b-e473-4fc9-9eb0-e63da31431e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.792850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa46b-e473-4fc9-9eb0-e63da31431e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.793748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa46b-e473-4fc9-9eb0-e63da31431e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.795560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa46b-e473-4fc9-9eb0-e63da31431e8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.798149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1067/2144] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:33 2022] DELETE /identity/v3/users/013505f7b213454c88811ef229ad5c60 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:33.816379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1078/2145] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:33.816848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:33.818350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:33.898047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba512d2-2262-4a6c-ac5f-b29d58fb6302 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:33.903449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:33.904555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.904840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.905119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] PATH_INFO: `/v3/projects/a0baed6aa16444c79fcf1f2183b2d768/users/022067e92dd14c8bbfc712924173fb16/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.922121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0baed6aa16444c79fcf1f2183b2d768, user_id=022067e92dd14c8bbfc712924173fb16, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:33.925146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:33.940149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1068/2146] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:33 2022] PUT /identity/v3/projects/a0baed6aa16444c79fcf1f2183b2d768/users/022067e92dd14c8bbfc712924173fb16/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:33.945660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:33.945952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:33.946236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:33.966144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:33.967349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:34.036513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1079/2147] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:34.045157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:34.047042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:34.117809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c15c8-5e1a-4b56-9f09-f1dce6f13633 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:34.122027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8239ee3-9154-4ce9-82d1-78f0c04741ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:34.122829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239ee3-9154-4ce9-82d1-78f0c04741ec service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:34.123117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239ee3-9154-4ce9-82d1-78f0c04741ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:34.123393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8239ee3-9154-4ce9-82d1-78f0c04741ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:34.135862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8239ee3-9154-4ce9-82d1-78f0c04741ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:34.137305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8239ee3-9154-4ce9-82d1-78f0c04741ec service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:34.151416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1069/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:34.314208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:34.315952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:34.346824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e83da-37c4-48e7-a6b8-c75c9e381b99 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:34.352566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:34.354304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:34.354784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:34.355090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] PATH_INFO: `/v3/projects/3bd791abfc4e43459425e98f79bb813d` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:34.356761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd791abfc4e43459425e98f79bb813d)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:34.359574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:34.445964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd791abfc4e43459425e98f79bb813d', 'request_id': 'req-75df30f7-a6e9-4467-90da-d3874d5ca970'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:34.454129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd791abfc4e43459425e98f79bb813d', 'request_id': 'req-75df30f7-a6e9-4467-90da-d3874d5ca970'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:34.461032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd791abfc4e43459425e98f79bb813d', 'request_id': 'req-75df30f7-a6e9-4467-90da-d3874d5ca970'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:34.483773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] The token cache is being invalidate because project 3bd791abfc4e43459425e98f79bb813d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:34.485349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:34.486403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-75df30f7-a6e9-4467-90da-d3874d5ca970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:34.493883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1080/2149] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:34 2022] DELETE /identity/v3/projects/3bd791abfc4e43459425e98f79bb813d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:34.499695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:34.499994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:34.500281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:34.541520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:34.542784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:34.651310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1070/2150] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:34.661465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:34.661827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:34.662111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:34.710776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:34.713455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:34.733103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1081/2151] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:34.737601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:34.753452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2f24a-86ba-49ba-9d3b-01025e85ee47 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:34.766144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:34.767377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:34.767827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:34.768111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:34.769096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:34.769408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:34.771071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:34.812678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1071/2152] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:59:34.814469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:34.827209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b6a76-7e64-4329-97fe-bdc3cc901f1e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:34.842439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:34.842439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:34.842439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:34.842439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:34.842763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:34.845261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:34.903811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1082/2153] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:34 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:34.907668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:34.925041 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf8a39-ec08-4650-a02d-5c41e7ef56c8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.022896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.024003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.024740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.025276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.026952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.030428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.058630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1072/2154] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:34 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:35.063574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.085210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76695b61-1dc6-4c1a-bcb7-a78ffed01a1c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.093628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.094302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.094583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.094854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.095615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.097387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.113158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1083/2155] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:35.117371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.128253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635569-2b44-4fb8-bbc6-04e3d0c1f642 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.133592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ec996-71ab-4c91-a612-7829081bd405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.134451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec996-71ab-4c91-a612-7829081bd405 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.134947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec996-71ab-4c91-a612-7829081bd405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.135423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ec996-71ab-4c91-a612-7829081bd405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.136354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ec996-71ab-4c91-a612-7829081bd405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.138420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ec996-71ab-4c91-a612-7829081bd405 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.159761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.161344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1073/2156] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:35.176124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80dffb-a08a-428f-8be9-85717b8833f3 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.182125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45cb1f-631a-4f94-8de3-153156803c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.183308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45cb1f-631a-4f94-8de3-153156803c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.183606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45cb1f-631a-4f94-8de3-153156803c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.183955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45cb1f-631a-4f94-8de3-153156803c77 admin admin] PATH_INFO: `/v3/projects/ad41d59450cf43418515b97fbc888a05/users/1a77a635c59c4399aaa8e999411c596c/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.211740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45cb1f-631a-4f94-8de3-153156803c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad41d59450cf43418515b97fbc888a05, user_id=1a77a635c59c4399aaa8e999411c596c, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.224770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45cb1f-631a-4f94-8de3-153156803c77 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.251758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1084/2157] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:35 2022] PUT /identity/v3/projects/ad41d59450cf43418515b97fbc888a05/users/1a77a635c59c4399aaa8e999411c596c/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:35.254267 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.254764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.255226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.273534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.273825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.274106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.290967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] MFA Rules not processed for user `1a77a635c59c4399aaa8e999411c596c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:35.292430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:35.318112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] MFA Rules not processed for user `022067e92dd14c8bbfc712924173fb16`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:35.319465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:35.406540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1074/2158] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:35.411810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.418242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1085/2159] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:35.429711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.431176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:35.500962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be118b0-a068-4810-bb4a-39b6987dc663 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.506588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.507278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.507589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.507874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.508681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.510558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.520644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce332f73-4e33-4818-8d43-780828c2ae74 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.525430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.526078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.526466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.526833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.538394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.540094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.544193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1075/2160] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:35 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:35.548622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.550342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1086/2161] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 15:59:35.631703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cc5cd-5f7d-46c3-992e-7b49efafacbc admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.631703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.631703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.631703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.632289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.632289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.634159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.655558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1076/2162] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:35 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:35.658710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.669219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8010164-8b87-4c11-a192-dae3249a1f17 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.673909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.674562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.674841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.675116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.675868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.677798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.687783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1087/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:35.692008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.702856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669c990-b072-4c8b-a80e-67d7113aa957 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.710281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.711167 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.711443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.712242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] PATH_INFO: `/v3/projects/609c7e8cc76a440eb4fb1b7c40928353/users/c45a49c68ebd46b18ea4dcc8d2577412/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.728287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] RBAC: Authorizing `identity:create_grant(project_id=609c7e8cc76a440eb4fb1b7c40928353, user_id=c45a49c68ebd46b18ea4dcc8d2577412, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.731034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.743515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1077/2164] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:35 2022] PUT /identity/v3/projects/609c7e8cc76a440eb4fb1b7c40928353/users/c45a49c68ebd46b18ea4dcc8d2577412/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:35.747827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.758347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a5a99-70da-4579-9fda-b0a87cb7a1c9 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.831914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3ac26-d4eb-4045-9f5a-aeca5f23aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.832618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ac26-d4eb-4045-9f5a-aeca5f23aed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.832914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ac26-d4eb-4045-9f5a-aeca5f23aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.833200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3ac26-d4eb-4045-9f5a-aeca5f23aed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.834445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3ac26-d4eb-4045-9f5a-aeca5f23aed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.836111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3ac26-d4eb-4045-9f5a-aeca5f23aed5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.847559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1088/2165] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:35.853939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:35.866302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456af8-15f5-4d9d-b92a-f2b7ea25995d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:35.871946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:35.872967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.873252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.873538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] PATH_INFO: `/v3/projects/609c7e8cc76a440eb4fb1b7c40928353/users/c45a49c68ebd46b18ea4dcc8d2577412/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.875800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=609c7e8cc76a440eb4fb1b7c40928353, user_id=c45a49c68ebd46b18ea4dcc8d2577412, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:35.878420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:35.889599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1078/2166] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:35 2022] PUT /identity/v3/projects/609c7e8cc76a440eb4fb1b7c40928353/users/c45a49c68ebd46b18ea4dcc8d2577412/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:35.901027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc924-aab0-4768-8c70-43798806042b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:35.901324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc924-aab0-4768-8c70-43798806042b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:35.901606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbc924-aab0-4768-8c70-43798806042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:35.928333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-82fbc924-aab0-4768-8c70-43798806042b None None] MFA Rules not processed for user `c45a49c68ebd46b18ea4dcc8d2577412`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:35.929720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-82fbc924-aab0-4768-8c70-43798806042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:35.994934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1089/2167] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:36.006696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:36.059762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21063ab4-3b57-4ee1-936b-a86361a4b34d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:36.063294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:36.063945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:36.064228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:36.064502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:36.117979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:36.119389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:36.127840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1079/2168] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:40.198380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:40.198943 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:40.198943 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:40.218744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:40.219978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:40.281116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1090/2169] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 15:59:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:40.325054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:40.326644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:40.405691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799f633-a064-4812-85e9-61c70dddb60f service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:40.411716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e3e6b-f023-4d2b-8d03-6f693410f246 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:40.412380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e3e6b-f023-4d2b-8d03-6f693410f246 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:40.412665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e3e6b-f023-4d2b-8d03-6f693410f246 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:40.413001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e3e6b-f023-4d2b-8d03-6f693410f246 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:40.422182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e3e6b-f023-4d2b-8d03-6f693410f246 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:40.423824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e3e6b-f023-4d2b-8d03-6f693410f246 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:40.433539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1080/2170] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 15:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 15:59:41.079211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:41.086559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:41.143960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c07b-0089-4b13-a83f-58763a608d5e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:41.144720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c07b-0089-4b13-a83f-58763a608d5e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:41.145365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62c07b-0089-4b13-a83f-58763a608d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:41.165581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1b62c07b-0089-4b13-a83f-58763a608d5e None None] MFA Rules not processed for user `022067e92dd14c8bbfc712924173fb16`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:41.167229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1b62c07b-0089-4b13-a83f-58763a608d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:41.198116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559808d-8412-40b5-a96d-3fb5cd1b35b6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:41.203065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:41.204001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:41.204283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:41.204554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] PATH_INFO: `/v3/users/bdff5c66374644a9925deac42e11fdd3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:41.205769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdff5c66374644a9925deac42e11fdd3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:41.207848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:41.267807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1081/2171] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:41.311822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdff5c66374644a9925deac42e11fdd3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:41.312816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdff5c66374644a9925deac42e11fdd3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:41.342683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdff5c66374644a9925deac42e11fdd3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:41.354525 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdff5c66374644a9925deac42e11fdd3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:41.356447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdff5c66374644a9925deac42e11fdd3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:41.371636 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1091/2172] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:41 2022] DELETE /identity/v3/users/bdff5c66374644a9925deac42e11fdd3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:41.376179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:41.376752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:41.376974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:41.398707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:41.400541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:41.477497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1082/2173] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:41.510430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:41.511997 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:41.597623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e379-2c26-46c3-8ec8-c8735a9eb4d9 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:41.605362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f0fd-061c-4046-a6c6-e8423549498d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:41.607104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f0fd-061c-4046-a6c6-e8423549498d service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:41.607601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f0fd-061c-4046-a6c6-e8423549498d service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:41.608651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f0fd-061c-4046-a6c6-e8423549498d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:41.622028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f0fd-061c-4046-a6c6-e8423549498d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:41.624420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f0fd-061c-4046-a6c6-e8423549498d service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:41.636153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1092/2174] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:41.889406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:41.891828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:41.921290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b03edc-bdba-427c-8b3b-d537526599e7 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:41.930280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:41.931577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:41.932478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:41.933192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] PATH_INFO: `/v3/users/1a77a635c59c4399aaa8e999411c596c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:41.934689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a77a635c59c4399aaa8e999411c596c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:41.939732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:42.023304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a77a635c59c4399aaa8e999411c596c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.046795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a77a635c59c4399aaa8e999411c596c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.081245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a77a635c59c4399aaa8e999411c596c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.082056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a77a635c59c4399aaa8e999411c596c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.096071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a77a635c59c4399aaa8e999411c596c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.106653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1083/2175] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:41 2022] DELETE /identity/v3/users/1a77a635c59c4399aaa8e999411c596c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:42.111144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:42.111460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:42.111926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:42.155871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:42.158035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:42.260438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1093/2176] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:42.277126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:42.278658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:42.351955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:42.353628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:42.371780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb32c-7c11-41f8-b3ba-520f3df6336c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:42.378750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:42.380283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:42.380759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:42.381043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] PATH_INFO: `/v3/projects/ffc0ea2a5dac43af8baaafc09565508e` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:42.382291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc0ea2a5dac43af8baaafc09565508e)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:42.384502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:42.413047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb74e0-1ebc-47f4-b076-f4fd76a22823 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:42.423672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:42.424611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:42.425058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:42.425485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:42.438927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:42.440972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:42.461857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1084/2177] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:42.465786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc0ea2a5dac43af8baaafc09565508e', 'request_id': 'req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.473155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc0ea2a5dac43af8baaafc09565508e', 'request_id': 'req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.479680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc0ea2a5dac43af8baaafc09565508e', 'request_id': 'req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.507820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] The token cache is being invalidate because project ffc0ea2a5dac43af8baaafc09565508e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:42.508569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.510095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.518018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:42.519135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1094/2178] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:42 2022] DELETE /identity/v3/projects/ffc0ea2a5dac43af8baaafc09565508e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:42.532240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7bc5f-c50c-4d52-9589-a11e60f3b40a service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:42.662509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:42.663942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:42.664256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:42.664621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] PATH_INFO: `/v3/users/8341c45607854ab79d15f200d5c50667` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:42.666359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8341c45607854ab79d15f200d5c50667)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:42.668996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:42.754477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8341c45607854ab79d15f200d5c50667'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.767816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8341c45607854ab79d15f200d5c50667'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.788504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8341c45607854ab79d15f200d5c50667'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.789231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8341c45607854ab79d15f200d5c50667'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.805383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8341c45607854ab79d15f200d5c50667'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:42.819393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1085/2179] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:42 2022] DELETE /identity/v3/users/8341c45607854ab79d15f200d5c50667 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:42.984650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:42.986220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:43.025463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7db11-aaf3-4758-8fd2-a7a9606e6649 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:43.122240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:43.123433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:43.123832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:43.124188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] PATH_INFO: `/v3/projects/ad41d59450cf43418515b97fbc888a05` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:43.125459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad41d59450cf43418515b97fbc888a05)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:43.127461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:43.183015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad41d59450cf43418515b97fbc888a05', 'request_id': 'req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.191466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad41d59450cf43418515b97fbc888a05', 'request_id': 'req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.199697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad41d59450cf43418515b97fbc888a05', 'request_id': 'req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.238823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] The token cache is being invalidate because project ad41d59450cf43418515b97fbc888a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:43.239130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.241776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.248580 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1095/2180] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:42 2022] DELETE /identity/v3/projects/ad41d59450cf43418515b97fbc888a05 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:43.250240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:43.252120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:43.283268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593bd74-724c-4cb1-94ff-4f12d8f4c379 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:43.396175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:43.397494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:43.397994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:43.398667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] PATH_INFO: `/v3/users/c45a49c68ebd46b18ea4dcc8d2577412` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:43.400719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45a49c68ebd46b18ea4dcc8d2577412)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:43.410109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:43.497739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45a49c68ebd46b18ea4dcc8d2577412'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.521837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45a49c68ebd46b18ea4dcc8d2577412'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.560273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45a49c68ebd46b18ea4dcc8d2577412'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.570251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45a49c68ebd46b18ea4dcc8d2577412'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.585626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cf757c97-e36f-4189-97e3-6920b8153eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45a49c68ebd46b18ea4dcc8d2577412'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.595823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1086/2181] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:43 2022] DELETE /identity/v3/users/c45a49c68ebd46b18ea4dcc8d2577412 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:43.700578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:43.702465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:43.722734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8498f1-6c00-4c44-aa8e-eb573576b7f5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:43.815519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:43.816470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:43.816758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:43.817552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] PATH_INFO: `/v3/projects/13abad7a90c44e8ca9ac35dc407af8b1` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:43.819477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13abad7a90c44e8ca9ac35dc407af8b1)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:43.821483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:43.905393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13abad7a90c44e8ca9ac35dc407af8b1', 'request_id': 'req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.916045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13abad7a90c44e8ca9ac35dc407af8b1', 'request_id': 'req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.922289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13abad7a90c44e8ca9ac35dc407af8b1', 'request_id': 'req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.945455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] The token cache is being invalidate because project 13abad7a90c44e8ca9ac35dc407af8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:43.945896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.947013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:43.949450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1096/2182] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:43 2022] DELETE /identity/v3/projects/13abad7a90c44e8ca9ac35dc407af8b1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:43.955791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692639f4-a1dc-45b2-8c9b-cf749cbd041c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:43.956088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692639f4-a1dc-45b2-8c9b-cf749cbd041c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:43.956374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692639f4-a1dc-45b2-8c9b-cf749cbd041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:43.986761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-692639f4-a1dc-45b2-8c9b-cf749cbd041c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:43.988418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-692639f4-a1dc-45b2-8c9b-cf749cbd041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:44.067402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.069149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:44.084326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1087/2183] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:44.092089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8333a51-ede0-46bb-ba6c-fddb6863c0e3 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.094216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.094644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.095001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.126089 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.131773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.133449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.133743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] PATH_INFO: `/v3/projects/609c7e8cc76a440eb4fb1b7c40928353` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.135099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=609c7e8cc76a440eb4fb1b7c40928353)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.137331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.140550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:44.144769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:44.157017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1088/2184] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:44.161250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.170878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878cdbc-22d2-4533-a1b3-492fa993f1f4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.175923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.177685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.178042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.178640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.179254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:44.179665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.181395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.197525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1089/2185] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 15:59:44.202199 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.216395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb1b76-e296-4612-b857-f32c8fcba5d3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.234967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609c7e8cc76a440eb4fb1b7c40928353', 'request_id': 'req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:44.242709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609c7e8cc76a440eb4fb1b7c40928353', 'request_id': 'req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:44.250032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609c7e8cc76a440eb4fb1b7c40928353', 'request_id': 'req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:44.272235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] The token cache is being invalidate because project 609c7e8cc76a440eb4fb1b7c40928353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:44.274101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:44.275708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-84a3b656-a7b3-49b4-b83b-0d12ca69b2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:44.279288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1097/2186] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:44 2022] DELETE /identity/v3/projects/609c7e8cc76a440eb4fb1b7c40928353 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:44.288660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369ff2-75ee-4c38-a06e-a375a6dca706 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.289007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369ff2-75ee-4c38-a06e-a375a6dca706 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.289347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f369ff2-75ee-4c38-a06e-a375a6dca706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.337575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8f369ff2-75ee-4c38-a06e-a375a6dca706 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:44.339103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8f369ff2-75ee-4c38-a06e-a375a6dca706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:44.342268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.344534 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.345205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.346721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.347497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.348008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1098/2187] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:44.356966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.357541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.357927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.367989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.378000 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:44.379714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:44.388961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1099/2188] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:44.393261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.403124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54797cea-cea7-4bab-b09c-21960f67ad41 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.408969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.410045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.410575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.411125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.412167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:44.412752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.414786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.430270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1090/2189] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:44.435895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.440305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:44.445103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1100/2190] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:59:44.447891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.458954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deac2-5766-47ce-bc95-5e3bef8f804d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.526093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.527010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.527578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.528079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.529105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.531413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.572582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1101/2191] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:44.584370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.650194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bbb3e-65a9-4827-a33f-7e3bf8789f0c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.681265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be360c-f05c-4cf2-8cf4-af4a994a4c22 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.686459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.687147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.687444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.687746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.688456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.690774 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.719478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1102/2192] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:44.721045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.737121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb9d0-70d9-433d-8524-a106d95558c6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.744691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.746261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.746667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.746947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.748631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.752069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.773357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.776566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1103/2193] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:44.776719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.776719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.776719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.776719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.778113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.778664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.793364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037494d-f378-4997-9c5b-160061c95b28 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.803298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.804623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.805142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.805649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.806400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1091/2194] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:44.807010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.809284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.810448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.822441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1104/2195] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:44.826787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.829718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d33bf-01c6-46ad-95bf-0cfae43900d3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.836885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.838136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.838628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.838860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374e69-8c03-428a-a255-c3f42fc531f7 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.839215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.840240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.841998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.844177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec08d73-4e87-42d6-a4ac-51d9ec42ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.845777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08d73-4e87-42d6-a4ac-51d9ec42ed58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.846259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08d73-4e87-42d6-a4ac-51d9ec42ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.846711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08d73-4e87-42d6-a4ac-51d9ec42ed58 admin admin] PATH_INFO: `/v3/projects/246f00838d3544e98ffdb36f7b812549/users/06a029ef6e9c4c848385116ca56e082e/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.859852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1092/2196] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:44.869857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.872388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec08d73-4e87-42d6-a4ac-51d9ec42ed58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246f00838d3544e98ffdb36f7b812549, user_id=06a029ef6e9c4c848385116ca56e082e, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.876246 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec08d73-4e87-42d6-a4ac-51d9ec42ed58 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.890100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc523a-1b94-4ccd-a33c-e3489d31b4ee admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.899134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:44.899859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.900150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.900441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.901224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:44.902892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:44.915569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1093/2197] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:44.919880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:44.931285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1105/2198] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:44 2022] PUT /identity/v3/projects/246f00838d3544e98ffdb36f7b812549/users/06a029ef6e9c4c848385116ca56e082e/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:44.933140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:44.934735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:44.934735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:44.934952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f5343-bfc4-48db-835d-6518c66eedaa admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:44.986417 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] MFA Rules not processed for user `06a029ef6e9c4c848385116ca56e082e`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:44.990039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:45.004169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df229a-5dbd-43b9-9089-bf25e1354c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.005778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df229a-5dbd-43b9-9089-bf25e1354c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.006059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df229a-5dbd-43b9-9089-bf25e1354c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.008765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df229a-5dbd-43b9-9089-bf25e1354c1c admin admin] PATH_INFO: `/v3/projects/2297b6e26d2b4f5da168caf259908e9c/users/c3bea8f87da34e2c9856a3883538decc/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.033960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df229a-5dbd-43b9-9089-bf25e1354c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2297b6e26d2b4f5da168caf259908e9c, user_id=c3bea8f87da34e2c9856a3883538decc, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.036724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df229a-5dbd-43b9-9089-bf25e1354c1c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.060755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1094/2199] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:44 2022] PUT /identity/v3/projects/2297b6e26d2b4f5da168caf259908e9c/users/c3bea8f87da34e2c9856a3883538decc/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:45.073973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.074404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.074888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.130657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1106/2200] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 15:59:45.135942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.172929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] MFA Rules not processed for user `c3bea8f87da34e2c9856a3883538decc`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:45.174642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:45.182205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def5649-a93b-4479-85d7-95158bad9b9a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.280920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.282811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.283453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.284525 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.285422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.290928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.327604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1095/2201] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:45.341310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.356886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71700c13-21bf-4c67-bf54-1140c9e139df None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.363299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.364069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.380310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.380310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.380310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.380310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.410572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1107/2202] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:45 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:45.415660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.454346 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1096/2203] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:45 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:45.455281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.494048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2012b45-330d-4681-996c-59c1412b9e82 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.548627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702295-5c45-4880-b7f5-11bf50f32953 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.562417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.563424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.563893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.564432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.565342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.567712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.661143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1097/2204] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:45 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:45.665172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.689208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.696284 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.696778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.696902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.700015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.707567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.713315 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d502e24-1a09-4931-8082-32c76869e8a4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.742824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.743515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.747220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.747220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.748928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.749923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.775608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1108/2205] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:45 2022] POST /identity/v3/users => generated 292 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:45.776536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.782531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1098/2206] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:45.787113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.802335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e823-bc9c-427a-9f93-05b9530a254e admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.812377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c60d83-d40d-4de9-a71e-f4f07d8d8cfe admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.817711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.818641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.818931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.819219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] PATH_INFO: `/v3/projects/46a9b0e421644f95949a7074e23dbf19/users/e83b61ffdac84672a139803355efcd7b/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.822898 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.825160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.825458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.826220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.827022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.834107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.837371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a9b0e421644f95949a7074e23dbf19, user_id=e83b61ffdac84672a139803355efcd7b, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.840382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:45.857758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1099/2207] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:45 2022] PUT /identity/v3/projects/46a9b0e421644f95949a7074e23dbf19/users/e83b61ffdac84672a139803355efcd7b/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:45.860642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1109/2208] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:45.861769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.864934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:45.875152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa559a-41c5-42e4-ae11-c37edc7ef520 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:45.976760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:45.977805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:45.978463 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:45.978769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:45.979620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:45.985842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.007690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1110/2209] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 15:59:46.014796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.035998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8bed6-0d39-4230-9b07-166cf47d7068 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.037738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a2c84-4efc-4ade-9bfe-f5832f5f9d05 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.044242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac55ca-0b70-4491-9b3d-aca942ea4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.045920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac55ca-0b70-4491-9b3d-aca942ea4f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.046357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac55ca-0b70-4491-9b3d-aca942ea4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.046646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac55ca-0b70-4491-9b3d-aca942ea4f65 admin admin] PATH_INFO: `/v3/projects/343512aad6cc47fa9329a70e66691473/users/b1efa3fbe4d74e2dae843e38aa1a99c7/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.053169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.054204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.056527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.057059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.060288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.063488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.069619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac55ca-0b70-4491-9b3d-aca942ea4f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=343512aad6cc47fa9329a70e66691473, user_id=b1efa3fbe4d74e2dae843e38aa1a99c7, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.072798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac55ca-0b70-4491-9b3d-aca942ea4f65 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.091419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1100/2210] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:46.096410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.106577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1111/2211] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:46 2022] PUT /identity/v3/projects/343512aad6cc47fa9329a70e66691473/users/b1efa3fbe4d74e2dae843e38aa1a99c7/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:46.116892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.118658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.119042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.134142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9175c3-a5e5-4034-ab71-0a90abd0473e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.158550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] MFA Rules not processed for user `b1efa3fbe4d74e2dae843e38aa1a99c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:46.160110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:46.241911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1112/2212] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:46.243679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.264796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9e46-462e-4117-9489-0b7f1cac7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.267309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9e46-462e-4117-9489-0b7f1cac7c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.267702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9e46-462e-4117-9489-0b7f1cac7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.268980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9e46-462e-4117-9489-0b7f1cac7c2b admin admin] PATH_INFO: `/v3/projects/46a9b0e421644f95949a7074e23dbf19/users/e83b61ffdac84672a139803355efcd7b/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.274893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9e46-462e-4117-9489-0b7f1cac7c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a9b0e421644f95949a7074e23dbf19, user_id=e83b61ffdac84672a139803355efcd7b, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.283976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9e46-462e-4117-9489-0b7f1cac7c2b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.310824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1101/2213] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:46 2022] PUT /identity/v3/projects/46a9b0e421644f95949a7074e23dbf19/users/e83b61ffdac84672a139803355efcd7b/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:46.324684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.325045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.326696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.377577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d55c7-1826-48fe-b7d7-a7567c884481 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.383681 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] MFA Rules not processed for user `e83b61ffdac84672a139803355efcd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:46.385020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:46.440203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.440986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.441338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.441689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.443030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.445087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.483192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1113/2214] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:46 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:46.485999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.521408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1102/2215] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:46.536457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.538542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:46.598674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee052c-3d74-407b-8682-60b9f6c1db3c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.605632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.606341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.606607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.606885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.607729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.610176 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.631719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4433-cb46-4980-baa6-19fa39d5d626 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.673222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1114/2216] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:46 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 15:59:46.677457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.700979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f2575-953b-4386-960d-b37cfc813d07 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.713817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.714589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.714995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.715470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.716289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.720142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.735400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.736804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.737291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.737775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.746462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1115/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:46.747560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.775828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041fa06-26ff-4765-80bb-05541e91ef77 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.792492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.793696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.794228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.794697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] PATH_INFO: `/v3/projects/75e7b1360df8477bb45605192a558e2c/users/1d6de568983240ec8a59073592b24c97/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.826280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e7b1360df8477bb45605192a558e2c, user_id=1d6de568983240ec8a59073592b24c97, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.829318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.838654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.844449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.852244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1116/2218] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:46 2022] PUT /identity/v3/projects/75e7b1360df8477bb45605192a558e2c/users/1d6de568983240ec8a59073592b24c97/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:46.856847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.879174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1103/2219] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:46.933745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9d4a9-817c-4f10-ae32-5e9c69f1e2a6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.940889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b8c0a-7ffc-4e4d-9527-2e2f2f4ec951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.941727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8c0a-7ffc-4e4d-9527-2e2f2f4ec951 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.942290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8c0a-7ffc-4e4d-9527-2e2f2f4ec951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.942668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8c0a-7ffc-4e4d-9527-2e2f2f4ec951 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.943546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8c0a-7ffc-4e4d-9527-2e2f2f4ec951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.945304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8c0a-7ffc-4e4d-9527-2e2f2f4ec951 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:46.959576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1117/2220] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:46.961128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:46.978881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926d32f-56af-47c0-bda0-900d9a78286e service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:46.984222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:46.985403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:46.985686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:46.985963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] PATH_INFO: `/v3/projects/75e7b1360df8477bb45605192a558e2c/users/1d6de568983240ec8a59073592b24c97/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:46.987973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e7b1360df8477bb45605192a558e2c, user_id=1d6de568983240ec8a59073592b24c97, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:46.991664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:47.014442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1104/2221] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:46 2022] PUT /identity/v3/projects/75e7b1360df8477bb45605192a558e2c/users/1d6de568983240ec8a59073592b24c97/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:47.015916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:47.016692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:47.016692 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:47.059693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] MFA Rules not processed for user `1d6de568983240ec8a59073592b24c97`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:47.061056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:47.182367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1118/2222] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:47.198906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:47.287903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a747-acdb-4c14-a1aa-25ce0abd1d53 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:47.294379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:47.295203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:47.295492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:47.295847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:47.447008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:47.452250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:47.487120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1105/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:50.325985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:50.336778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b06f15-1cf6-4783-bd1d-a2152c0dd4ac None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:50.340706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:50.341563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:50.341690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:50.342102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:50.419380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:50.421707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:50.439254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1119/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:51.114389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:51.124020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4e792-fe8f-45c2-8678-9c52a34a4096 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:51.135239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:51.135958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:51.136305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:51.136584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:51.148326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:51.155556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:51.176514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1106/2225] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:51.649141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:51.658695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26c07c-2ea7-4b9e-acf4-93762a54f633 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:51.663196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1445-6695-4b9d-a03c-4803bcba7f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:51.664135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1445-6695-4b9d-a03c-4803bcba7f64 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:51.664418 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1445-6695-4b9d-a03c-4803bcba7f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:51.664694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1445-6695-4b9d-a03c-4803bcba7f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:51.741853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa1445-6695-4b9d-a03c-4803bcba7f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:51.744004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa1445-6695-4b9d-a03c-4803bcba7f64 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:51.759659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1120/2226] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:55.360941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:55.445864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220dde-0748-4065-9fde-7ccbddc98eb9 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:55.450921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:55.452108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:55.452597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:55.453071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] PATH_INFO: `/v3/users/06a029ef6e9c4c848385116ca56e082e` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:55.454477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a029ef6e9c4c848385116ca56e082e)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:55.456667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:55.527451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a029ef6e9c4c848385116ca56e082e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:55.539466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a029ef6e9c4c848385116ca56e082e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:55.555061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a029ef6e9c4c848385116ca56e082e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:55.555993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a029ef6e9c4c848385116ca56e082e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:55.565107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a029ef6e9c4c848385116ca56e082e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:55.575770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1107/2227] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:55 2022] DELETE /identity/v3/users/06a029ef6e9c4c848385116ca56e082e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:55.577722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:55.578534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:55.578964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:55.606838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:55.608457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:55.713607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1121/2228] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:55.725792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:55.727957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:55.837073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2580de-df9f-4e34-8cf7-7e487b92f70f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:55.846184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:55.847000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:55.847398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:55.848721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:55.867975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:55.870536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:55.896639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1108/2229] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:56.302269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:56.304643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:56.322398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52378725-eb10-4d75-b0ff-c9a90269f170 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:56.327733 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:56.328800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:56.329091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:56.329366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] PATH_INFO: `/v3/projects/246f00838d3544e98ffdb36f7b812549` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:56.331010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246f00838d3544e98ffdb36f7b812549)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:56.334035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:56.396163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246f00838d3544e98ffdb36f7b812549', 'request_id': 'req-825f113c-9278-4807-9965-dc55ba07f465'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.403073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246f00838d3544e98ffdb36f7b812549', 'request_id': 'req-825f113c-9278-4807-9965-dc55ba07f465'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.414537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246f00838d3544e98ffdb36f7b812549', 'request_id': 'req-825f113c-9278-4807-9965-dc55ba07f465'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.432243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] The token cache is being invalidate because project 246f00838d3544e98ffdb36f7b812549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:56.432539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.433258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.435562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1122/2230] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:56 2022] DELETE /identity/v3/projects/246f00838d3544e98ffdb36f7b812549 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:56.439858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:56.453187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01033a-41d5-4840-823c-39a377ab089f service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:56.536462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:56.539508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:56.540142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:56.541045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] PATH_INFO: `/v3/users/b1efa3fbe4d74e2dae843e38aa1a99c7` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:56.542441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1efa3fbe4d74e2dae843e38aa1a99c7)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:56.545858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:56.608032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1efa3fbe4d74e2dae843e38aa1a99c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.619213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1efa3fbe4d74e2dae843e38aa1a99c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.635271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1efa3fbe4d74e2dae843e38aa1a99c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.636284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1efa3fbe4d74e2dae843e38aa1a99c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.646003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1efa3fbe4d74e2dae843e38aa1a99c7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:56.652895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1109/2231] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:56 2022] DELETE /identity/v3/users/b1efa3fbe4d74e2dae843e38aa1a99c7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:56.993413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:56.995080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:57.029471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f113c-9278-4807-9965-dc55ba07f465 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:57.072533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:57.074127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:57.166254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:57.167157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:57.167444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:57.167751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] PATH_INFO: `/v3/users/c3bea8f87da34e2c9856a3883538decc` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:57.169062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bea8f87da34e2c9856a3883538decc)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:57.171068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:57.212421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50f1f7-e39d-4a47-a714-dac39384c90e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:57.217706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:57.218772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:57.219071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:57.219372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] PATH_INFO: `/v3/projects/343512aad6cc47fa9329a70e66691473` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:57.220876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=343512aad6cc47fa9329a70e66691473)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:57.225399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:57.290967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bea8f87da34e2c9856a3883538decc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.291969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bea8f87da34e2c9856a3883538decc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.294007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343512aad6cc47fa9329a70e66691473', 'request_id': 'req-58ebd8d9-6a1d-46cc-b287-3241cccfa986'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.305792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343512aad6cc47fa9329a70e66691473', 'request_id': 'req-58ebd8d9-6a1d-46cc-b287-3241cccfa986'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.313086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343512aad6cc47fa9329a70e66691473', 'request_id': 'req-58ebd8d9-6a1d-46cc-b287-3241cccfa986'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.317348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bea8f87da34e2c9856a3883538decc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.326395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bea8f87da34e2c9856a3883538decc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.327654 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-a61a508e-3341-4e50-a017-fc3b5ae5eae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bea8f87da34e2c9856a3883538decc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.330471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] The token cache is being invalidate because project 343512aad6cc47fa9329a70e66691473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:57.331058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.332593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.338559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1110/2232] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:57 2022] DELETE /identity/v3/projects/343512aad6cc47fa9329a70e66691473 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 15:59:57.344203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1123/2233] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:56 2022] DELETE /identity/v3/users/c3bea8f87da34e2c9856a3883538decc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:57.349230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:57.349703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:57.350152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:57.350522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:57.352335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:57.376185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:57.377976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:57.462015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebd8d9-6a1d-46cc-b287-3241cccfa986 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:57.474557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1124/2234] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:57.486410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:57.495590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:57.607204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:57.608418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:57.608859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:57.609291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] PATH_INFO: `/v3/users/1d6de568983240ec8a59073592b24c97` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:57.611241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6de568983240ec8a59073592b24c97)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:57.614011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:57.616244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ca2e3-f163-4170-afc0-399a12cd7327 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:57.630064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:57.630865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:57.631210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:57.632780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:57.649841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:57.651539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:57.665634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1125/2235] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 15:59:57.692093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6de568983240ec8a59073592b24c97'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.708297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6de568983240ec8a59073592b24c97'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.726416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6de568983240ec8a59073592b24c97'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.728496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6de568983240ec8a59073592b24c97'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.739118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6de568983240ec8a59073592b24c97'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:57.757106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1111/2236] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:57 2022] DELETE /identity/v3/users/1d6de568983240ec8a59073592b24c97 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:58.069273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.070836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:58.111563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47346957-392f-4c15-bf60-5604edc0c0eb service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.205959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.206987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.210544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.210544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] PATH_INFO: `/v3/projects/2297b6e26d2b4f5da168caf259908e9c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.210944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.211054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2297b6e26d2b4f5da168caf259908e9c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.211457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:58.217474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.233966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371522-7dbd-4039-b576-e16d3028c9fe admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.245759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.246822 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.247204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.250414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] PATH_INFO: `/v3/projects/75e7b1360df8477bb45605192a558e2c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.256597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e7b1360df8477bb45605192a558e2c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.260989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.296520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2297b6e26d2b4f5da168caf259908e9c', 'request_id': 'req-05eb851c-6685-4288-ae9d-f89e68542fd2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.305656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2297b6e26d2b4f5da168caf259908e9c', 'request_id': 'req-05eb851c-6685-4288-ae9d-f89e68542fd2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.313549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2297b6e26d2b4f5da168caf259908e9c', 'request_id': 'req-05eb851c-6685-4288-ae9d-f89e68542fd2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.333001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] The token cache is being invalidate because project 2297b6e26d2b4f5da168caf259908e9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:58.333366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.333853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e7b1360df8477bb45605192a558e2c', 'request_id': 'req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.333973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.335909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1126/2237] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:58 2022] DELETE /identity/v3/projects/2297b6e26d2b4f5da168caf259908e9c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:58.340245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.342240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:58.346788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e7b1360df8477bb45605192a558e2c', 'request_id': 'req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.358805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e7b1360df8477bb45605192a558e2c', 'request_id': 'req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.376933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] The token cache is being invalidate because project 75e7b1360df8477bb45605192a558e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:58.377228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.378102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e68d6bf-6b97-498f-be5d-790dd96aa0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.383949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1112/2238] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:58 2022] DELETE /identity/v3/projects/75e7b1360df8477bb45605192a558e2c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:58.385399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01274769-890a-4197-b281-f9fef4a39745 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.385695 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01274769-890a-4197-b281-f9fef4a39745 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.385976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01274769-890a-4197-b281-f9fef4a39745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.406706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-01274769-890a-4197-b281-f9fef4a39745 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:58.408191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-01274769-890a-4197-b281-f9fef4a39745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:58.424557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb851c-6685-4288-ae9d-f89e68542fd2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.481747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1113/2239] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:58.490892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.491387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.491835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.511817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:58.513340 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:58.531025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1114/2240] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:58.531221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.531221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.531221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.531221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] PATH_INFO: `/v3/users/e83b61ffdac84672a139803355efcd7b` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.532339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.532748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83b61ffdac84672a139803355efcd7b)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.534673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.547138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c2649-21d4-4b0a-b66d-7166b9752f1e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.552339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.553015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.553426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.553534 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.554258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:58.554597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.556422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.568479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1115/2241] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:59:58.572652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.589256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb242fea-0aef-49e4-ab07-97be63f98924 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.601942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.603770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.604073 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.604345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.605082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.607072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.620445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83b61ffdac84672a139803355efcd7b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.623135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83b61ffdac84672a139803355efcd7b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.647587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1116/2242] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:58 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:58.648507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83b61ffdac84672a139803355efcd7b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.652446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.662827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83b61ffdac84672a139803355efcd7b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.663598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83b61ffdac84672a139803355efcd7b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:58.696872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1127/2243] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 15:59:58 2022] DELETE /identity/v3/users/e83b61ffdac84672a139803355efcd7b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:58.791712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d265-865d-45cf-8c0b-d4176a9e819f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.881463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.882628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.882929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.883218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.884951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.888056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.916282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1117/2244] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:58 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:58.921247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.923064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:58.940661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452632e-9a4d-47d5-83ba-a743826529b6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.948483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.949167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.949450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.949729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:58.950466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:58.952857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:58.970508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1128/2245] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:58.972077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:58.985493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8bf995-8810-4ebf-b498-2f0746d2a41a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:58.997310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:58.998277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:58.998730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:58.999209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.000212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.002084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.014081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1118/2246] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:59.019113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.035210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc00d3-1b6c-4a11-94cf-56a1e1fabe9f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.044467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70672fbf-2e23-4c75-a1f6-84018e2e351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.045085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672fbf-2e23-4c75-a1f6-84018e2e351d admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.045381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672fbf-2e23-4c75-a1f6-84018e2e351d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.046012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672fbf-2e23-4c75-a1f6-84018e2e351d admin admin] PATH_INFO: `/v3/projects/e51e349d30f04a329ed82d69029c25fa/users/e0d8036db9d6455aaa0a25352cb6c555/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.066329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.068490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672fbf-2e23-4c75-a1f6-84018e2e351d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51e349d30f04a329ed82d69029c25fa, user_id=e0d8036db9d6455aaa0a25352cb6c555, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.069087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:59.072702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672fbf-2e23-4c75-a1f6-84018e2e351d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.100007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ebe31-43ac-472a-8fc8-4c391d13bb44 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.107916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1129/2247] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:59 2022] PUT /identity/v3/projects/e51e349d30f04a329ed82d69029c25fa/users/e0d8036db9d6455aaa0a25352cb6c555/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:59.122914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185597ed-f169-4e26-b0bd-079cd54c3f38 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.123111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185597ed-f169-4e26-b0bd-079cd54c3f38 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.123381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185597ed-f169-4e26-b0bd-079cd54c3f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.154498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-185597ed-f169-4e26-b0bd-079cd54c3f38 None None] MFA Rules not processed for user `e0d8036db9d6455aaa0a25352cb6c555`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:59.155984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-185597ed-f169-4e26-b0bd-079cd54c3f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:59.179446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.180687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.180970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.181244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] PATH_INFO: `/v3/projects/46a9b0e421644f95949a7074e23dbf19` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.182466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a9b0e421644f95949a7074e23dbf19)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.184884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.244744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1130/2248] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:59.252005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a9b0e421644f95949a7074e23dbf19', 'request_id': 'req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:59.261292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a9b0e421644f95949a7074e23dbf19', 'request_id': 'req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:59.267189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a9b0e421644f95949a7074e23dbf19', 'request_id': 'req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:59.280720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] The token cache is being invalidate because project 46a9b0e421644f95949a7074e23dbf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 15:59:59.280981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:59.281655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-b4f96fa9-9a0e-4b51-aacf-a80dc35d9e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 15:59:59.283412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1119/2249] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 15:59:59 2022] DELETE /identity/v3/projects/46a9b0e421644f95949a7074e23dbf19 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:59.289412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.290139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.290614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.312115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:59.313798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:59.391867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1131/2250] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:59.406755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.407460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.407596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.432842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:59.434255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:59.443342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1120/2251] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:59.448032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.458863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884920-785b-4e5b-bac6-1bb08b1f08bd None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.464261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.465164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.465450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.465754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.466606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 15:59:59.466920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.468608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.481616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1132/2252] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 15:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 15:59:59.486263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.496738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d42888-b31a-48ae-9332-1b0c672a5eb9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.503506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.504232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.504708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.504951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.505669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.508342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.538993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1121/2253] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 15:59:59 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:59.543434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.553685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900ef61-3759-44e4-8c21-0983339857b3 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.623949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.624722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.625007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.625309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.626303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.629925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.656913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1133/2254] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 15:59:59 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 15:59:59.658536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.669627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f23299-164c-45a3-900c-664b804a2a5c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.674393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.675044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.675328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.675666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.676664 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.678474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.694259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1122/2255] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:59.698897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.711740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34983-36a7-4691-8262-1eee71c11766 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.720165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a511082-8cbb-473a-bc94-723720f25aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.720893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511082-8cbb-473a-bc94-723720f25aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.721242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511082-8cbb-473a-bc94-723720f25aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.721670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a511082-8cbb-473a-bc94-723720f25aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.722813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511082-8cbb-473a-bc94-723720f25aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.725027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a511082-8cbb-473a-bc94-723720f25aa6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.738127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1134/2256] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 15:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 15:59:59.742622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.754418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8390-ad75-4cac-9fd9-01402eb5cf99 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 15:59:59.764771 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 15:59:59.765713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.766040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.766317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] PATH_INFO: `/v3/projects/e4afb4288163492e886ad8e43fe7c935/users/b74384ca80ed4d5c99d190ad055ba0e3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.783830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4afb4288163492e886ad8e43fe7c935, user_id=b74384ca80ed4d5c99d190ad055ba0e3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 15:59:59.787400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 15:59:59.807615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1123/2257] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 15:59:59 2022] PUT /identity/v3/projects/e4afb4288163492e886ad8e43fe7c935/users/b74384ca80ed4d5c99d190ad055ba0e3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 15:59:59.818536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 15:59:59.818834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 15:59:59.819115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 15:59:59.847937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] MFA Rules not processed for user `b74384ca80ed4d5c99d190ad055ba0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 15:59:59.849173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:59.917925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1135/2258] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 15:59:59.930970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 15:59:59.933168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 15:59:59.998060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab310b2-c561-470c-b8d8-6ce7fdbc53d2 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:00.002049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329e92c-3ab7-48a3-a9a2-f9aec6e24303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:00.002931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e92c-3ab7-48a3-a9a2-f9aec6e24303 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:00.003217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e92c-3ab7-48a3-a9a2-f9aec6e24303 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:00.003724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329e92c-3ab7-48a3-a9a2-f9aec6e24303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:00.013827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329e92c-3ab7-48a3-a9a2-f9aec6e24303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:00.015389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329e92c-3ab7-48a3-a9a2-f9aec6e24303 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:00.027220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1124/2259] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 15:59:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:02.450911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:02.452305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:02.521388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14977fcc-e758-484c-aaba-7eb254fd4621 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:02.524993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:02.525646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:02.525937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:02.526218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:02.528080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:02.586827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:02.588331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:02.598409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1136/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:03.599099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:03.599613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:03.599708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:03.617004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:03.618194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:03.670478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1125/2261] 10.222.0.23 () {58 vars in 967 bytes} [Tue Mar 29 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:03.684479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:03.685853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:03.752880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c36a87-2f3b-4f11-92ca-91ceaad62992 service glance] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:03.758469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:03.759153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:03.759440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:03.759753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:03.768083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:03.769716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:03.777768 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1137/2262] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:00:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:00:18.291332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:18.292880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:18.421645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0ed42-ddc5-44bd-abca-6611b133faef None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:18.430469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:18.431811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:18.432253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:18.432538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] PATH_INFO: `/v3/users/7e296a6f0b144cc98812f26bf1f6a6f3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:18.433776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e296a6f0b144cc98812f26bf1f6a6f3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:18.435748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:18.481077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e296a6f0b144cc98812f26bf1f6a6f3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.487775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e296a6f0b144cc98812f26bf1f6a6f3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.499633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e296a6f0b144cc98812f26bf1f6a6f3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.500320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e296a6f0b144cc98812f26bf1f6a6f3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.507344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4674afb1-1e96-4f05-ad83-4736118856b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e296a6f0b144cc98812f26bf1f6a6f3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.513060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1126/2263] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:00:18 2022] DELETE /identity/v3/users/7e296a6f0b144cc98812f26bf1f6a6f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:00:18.689386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:18.724240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6013b41-b161-4095-82fa-6adc08e52389 service swift] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:18.805240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:18.809301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:18.809301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:18.809301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] PATH_INFO: `/v3/projects/12cf51fc3bca46acbe2cb7af7a92b59c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:18.809301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cf51fc3bca46acbe2cb7af7a92b59c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:18.812092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:18.869971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cf51fc3bca46acbe2cb7af7a92b59c', 'request_id': 'req-aff6f384-2952-40c4-b008-cf4440b4fa5b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.878005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cf51fc3bca46acbe2cb7af7a92b59c', 'request_id': 'req-aff6f384-2952-40c4-b008-cf4440b4fa5b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.885247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cf51fc3bca46acbe2cb7af7a92b59c', 'request_id': 'req-aff6f384-2952-40c4-b008-cf4440b4fa5b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.902705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] The token cache is being invalidate because project 12cf51fc3bca46acbe2cb7af7a92b59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:00:18.903081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.903762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-aff6f384-2952-40c4-b008-cf4440b4fa5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:18.905875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1138/2264] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:00:18 2022] DELETE /identity/v3/projects/12cf51fc3bca46acbe2cb7af7a92b59c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:18.913595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:18.913595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:18.913595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:18.973789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:18.974911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.035851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1127/2265] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:00:19.044211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.044506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.044791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.065586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:19.066800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.074728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1139/2266] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:19.078966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.088903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a6b31-a352-4f63-ba5e-0852e40a6404 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.093635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.094302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.094589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.094870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.095643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:00:19.096455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.098074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.109901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1128/2267] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:00:19.114816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.124043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b6055-19d9-4ae4-8a3f-a70b69d491cb None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.128939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.129597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.129876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.130148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.130867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.132885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.166117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1140/2268] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:00:19 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:00:19.170111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.181616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666b59-7ed5-4d0e-9006-80546e101b95 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.240769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.241443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.241728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.242006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.242723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.244674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.266342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1129/2269] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:00:19 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:00:19.270587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.280839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dab8ad-b2a4-4fdb-840b-a4db60361758 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.286422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.287160 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.287433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.287788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.288490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.290119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.304595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1141/2270] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:00:19.305747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.315821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6248a7-9880-401a-8ea1-b3898b177bff admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.320501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823169d8-a7c8-4347-9085-0a9f5a71e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.321153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823169d8-a7c8-4347-9085-0a9f5a71e6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.321460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823169d8-a7c8-4347-9085-0a9f5a71e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.321720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823169d8-a7c8-4347-9085-0a9f5a71e6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.322444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823169d8-a7c8-4347-9085-0a9f5a71e6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.324072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823169d8-a7c8-4347-9085-0a9f5a71e6d9 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.335026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1130/2271] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:00:19.338848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.349631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a11ce3-e3dc-4922-b3a4-014d649e4acf admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.354759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.355673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.355959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.356234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] PATH_INFO: `/v3/projects/437aea89beaa411ab338ef82c2a2fd86/users/99a495765fe14c7383b5937dad1ddac2/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.371912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=437aea89beaa411ab338ef82c2a2fd86, user_id=99a495765fe14c7383b5937dad1ddac2, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.374571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.389192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1142/2272] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:00:19 2022] PUT /identity/v3/projects/437aea89beaa411ab338ef82c2a2fd86/users/99a495765fe14c7383b5937dad1ddac2/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:19.400294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.400592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.400877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.427494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] MFA Rules not processed for user `99a495765fe14c7383b5937dad1ddac2`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:19.428776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.490499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1131/2273] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:00:19.507025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.510758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.587447 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc9aaa-17b9-4c7f-96b6-6e0a93cb84cb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.591037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca509cde-455e-4767-b421-0bd8aec3fb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.591706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca509cde-455e-4767-b421-0bd8aec3fb1a service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.591986 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca509cde-455e-4767-b421-0bd8aec3fb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.592260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca509cde-455e-4767-b421-0bd8aec3fb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.600172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca509cde-455e-4767-b421-0bd8aec3fb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.601599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca509cde-455e-4767-b421-0bd8aec3fb1a service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.609984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1143/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:19.635242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.701689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661fb7f-b651-4fbf-8389-75bc2dcedc4f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.706245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.707110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.707390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.707697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] PATH_INFO: `/v3/users/99a495765fe14c7383b5937dad1ddac2` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.708901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a495765fe14c7383b5937dad1ddac2)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.710859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.756725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a495765fe14c7383b5937dad1ddac2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:19.763948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a495765fe14c7383b5937dad1ddac2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:19.776060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a495765fe14c7383b5937dad1ddac2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:19.776794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a495765fe14c7383b5937dad1ddac2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:19.783965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a495765fe14c7383b5937dad1ddac2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:19.789876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1132/2275] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:00:19 2022] DELETE /identity/v3/users/99a495765fe14c7383b5937dad1ddac2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:19.794315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.794726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.794891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.815641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:19.816602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.878487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1144/2276] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:19.888254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.889655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.962383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:19.963959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:19.971868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dedd66-aceb-49f6-b387-95495a57304f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.975705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67ec0f-9538-48cf-a714-137c7cf7f49a None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:19.975969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b06c2-3b4e-4a2a-bcbe-dd2e3d46e821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.976646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b06c2-3b4e-4a2a-bcbe-dd2e3d46e821 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.976932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b06c2-3b4e-4a2a-bcbe-dd2e3d46e821 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.977240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b06c2-3b4e-4a2a-bcbe-dd2e3d46e821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.980635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:19.981530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:19.981812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:19.982086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] PATH_INFO: `/v3/users/b74384ca80ed4d5c99d190ad055ba0e3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:19.983279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74384ca80ed4d5c99d190ad055ba0e3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.985237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.986833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b06c2-3b4e-4a2a-bcbe-dd2e3d46e821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:19.988313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b06c2-3b4e-4a2a-bcbe-dd2e3d46e821 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:19.999621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1133/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:20.039087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74384ca80ed4d5c99d190ad055ba0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.040010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74384ca80ed4d5c99d190ad055ba0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.054505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74384ca80ed4d5c99d190ad055ba0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.063187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74384ca80ed4d5c99d190ad055ba0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.063863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74384ca80ed4d5c99d190ad055ba0e3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.077634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1145/2278] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:00:19 2022] DELETE /identity/v3/users/b74384ca80ed4d5c99d190ad055ba0e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:00:20.082794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.083303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.083684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.102496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:20.103776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.164072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1134/2279] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:00:20.174694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.176406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.235848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a0a71-3874-4180-bceb-3fc0dcde503b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.242465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff38720-5a34-46ae-b993-56d311efa94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.243179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff38720-5a34-46ae-b993-56d311efa94b service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.243607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff38720-5a34-46ae-b993-56d311efa94b service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.243957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff38720-5a34-46ae-b993-56d311efa94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.256564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff38720-5a34-46ae-b993-56d311efa94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.258064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff38720-5a34-46ae-b993-56d311efa94b service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.269505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1146/2280] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:00:20.284649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.286143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.298262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e588c-a52f-47b6-b810-52b1b7700a6c None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.305477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.306778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.307342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.307800 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] PATH_INFO: `/v3/projects/437aea89beaa411ab338ef82c2a2fd86` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.309221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437aea89beaa411ab338ef82c2a2fd86)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.311461 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.364483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437aea89beaa411ab338ef82c2a2fd86', 'request_id': 'req-8f17d3d0-6f25-4f43-9dba-66b71d168959'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.372348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437aea89beaa411ab338ef82c2a2fd86', 'request_id': 'req-8f17d3d0-6f25-4f43-9dba-66b71d168959'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.379847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437aea89beaa411ab338ef82c2a2fd86', 'request_id': 'req-8f17d3d0-6f25-4f43-9dba-66b71d168959'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.391463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] The token cache is being invalidate because project 437aea89beaa411ab338ef82c2a2fd86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:00:20.391794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.392482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8f17d3d0-6f25-4f43-9dba-66b71d168959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.394093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1135/2281] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:00:20 2022] DELETE /identity/v3/projects/437aea89beaa411ab338ef82c2a2fd86 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:20.399101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.399395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.399712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.418701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:20.419977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.489405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1147/2282] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:00:20.497084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.497359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.497640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.517101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:20.518471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.527290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1136/2283] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:20.531385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.541056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f86bd-b336-4229-88a9-8541c105403b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.545750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.546564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.546962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.547329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.548230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:00:20.548673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.551189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.564463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.565202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1148/2284] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:00:20.566571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.569110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.579035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f7ed4-9176-41d9-82e2-8423a0e04d1d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.579168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8944-8ec6-400c-8f9e-b9666d67321d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.584566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.584707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.585510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.585742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.585850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.586052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.586266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.586635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] PATH_INFO: `/v3/projects/e4afb4288163492e886ad8e43fe7c935` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.586778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.588063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4afb4288163492e886ad8e43fe7c935)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.588815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.590407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.619600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1149/2285] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:00:20.620675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.649622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4afb4288163492e886ad8e43fe7c935', 'request_id': 'req-5688b473-e8ec-47dc-9aa2-ed24b897351d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.656814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4afb4288163492e886ad8e43fe7c935', 'request_id': 'req-5688b473-e8ec-47dc-9aa2-ed24b897351d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.662905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4afb4288163492e886ad8e43fe7c935', 'request_id': 'req-5688b473-e8ec-47dc-9aa2-ed24b897351d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.674274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] The token cache is being invalidate because project e4afb4288163492e886ad8e43fe7c935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:00:20.674570 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.675221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5688b473-e8ec-47dc-9aa2-ed24b897351d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:20.677021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1137/2286] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:00:20 2022] DELETE /identity/v3/projects/e4afb4288163492e886ad8e43fe7c935 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:00:20.681657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef34c9a-9646-4489-88a8-45cfa217d32d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.681944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef34c9a-9646-4489-88a8-45cfa217d32d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.682222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef34c9a-9646-4489-88a8-45cfa217d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.685758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad235a-2e87-4f48-9e6f-e109ff3fa5b5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.702400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1ef34c9a-9646-4489-88a8-45cfa217d32d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:20.703803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1ef34c9a-9646-4489-88a8-45cfa217d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.748975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.748975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.748975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.748975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.749426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.750762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.771398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1150/2287] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:00:20.778855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1138/2288] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:00:20.779031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.779458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.780342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772e11-a06e-469a-98f9-42633447475e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.781078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772e11-a06e-469a-98f9-42633447475e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.781078 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f772e11-a06e-469a-98f9-42633447475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.792244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb533a58-108d-4f46-a964-de0580a5d786 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.797104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.797802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.798092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.798362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.799697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.799833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-6f772e11-a06e-469a-98f9-42633447475e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:20.801352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6f772e11-a06e-469a-98f9-42633447475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.801556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.811696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1139/2289] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:20.812199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1151/2290] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:00:20.815945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772e11-a06e-469a-98f9-42633447475e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.816087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.824883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f772e11-a06e-469a-98f9-42633447475e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.825488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15d30-e70c-4234-ad51-95927dbd4c38 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.829482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.830114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.830806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.830938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.831183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.831452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.831769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.831969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:00:20.832060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.832275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.832880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.833945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.834465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.848941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1152/2291] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:00:20.849390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1140/2292] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:00:20.850775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.852481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.861614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e66726-a37f-42be-9662-7264333658a2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.862093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce714aa-ca58-4f29-82a3-04865080c061 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.866721 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f9034-c587-49bc-81ff-be0965c85c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.867212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.867846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f9034-c587-49bc-81ff-be0965c85c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.868037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.868481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f9034-c587-49bc-81ff-be0965c85c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.868614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.868734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f9034-c587-49bc-81ff-be0965c85c3e admin admin] PATH_INFO: `/v3/projects/ac35dceb2ec34bfdb83d975ab8a245c4/users/7f3fbe218b1e426c9cd75a3e94820be2/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.868841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.869706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.874070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.888219 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f9034-c587-49bc-81ff-be0965c85c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac35dceb2ec34bfdb83d975ab8a245c4, user_id=7f3fbe218b1e426c9cd75a3e94820be2, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.890963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f9034-c587-49bc-81ff-be0965c85c3e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:20.903859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1141/2293] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:00:20.904388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1153/2294] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:00:20 2022] PUT /identity/v3/projects/ac35dceb2ec34bfdb83d975ab8a245c4/users/7f3fbe218b1e426c9cd75a3e94820be2/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:00:20.904835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:20.915336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.915653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.915933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.943250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] MFA Rules not processed for user `7f3fbe218b1e426c9cd75a3e94820be2`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:20.944666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:20.973562 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd290c-a2a2-4a5a-9e67-38d869ba5f1d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:20.978422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:20.979107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:20.979398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:20.979719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:20.980412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:20.982401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:21.003418 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1142/2295] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:00:21.007197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:21.012536 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1154/2296] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:00:21.017309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17be4d1-5002-4092-afed-f4904a5d9a61 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:21.022788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:21.023391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:21.023497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:21.023777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:21.024150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:21.024793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:21.024895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:21.026475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:21.037705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1143/2297] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:00:21.041611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:21.052813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cacef5-0eed-429a-955b-7600288919a2 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:21.057546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:21.058369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:21.058586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:21.058791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:21.059496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:21.061179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:21.072151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1144/2298] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:00:21.076441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:21.084617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f301d9-9392-406c-ba9a-66e181c3ddf1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:21.086304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1361875-9b32-4cde-a4c3-457bbaa9b83b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:21.088241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a9f8f-cc94-4956-9f70-7e901bd65eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:21.088886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a9f8f-cc94-4956-9f70-7e901bd65eaf service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:21.089166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a9f8f-cc94-4956-9f70-7e901bd65eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:21.089435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a9f8f-cc94-4956-9f70-7e901bd65eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:21.091019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:21.091925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:21.092211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:21.092488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] PATH_INFO: `/v3/projects/108268c0de3e42e2a61297efda6b51bb/users/3533bd2a4be249c488db12d3e1284eac/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:21.097811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a9f8f-cc94-4956-9f70-7e901bd65eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:21.099240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a9f8f-cc94-4956-9f70-7e901bd65eaf service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:21.107472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=108268c0de3e42e2a61297efda6b51bb, user_id=3533bd2a4be249c488db12d3e1284eac, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:21.108029 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1155/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:00:21.110443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:21.127670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1145/2300] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:00:21 2022] PUT /identity/v3/projects/108268c0de3e42e2a61297efda6b51bb/users/3533bd2a4be249c488db12d3e1284eac/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:21.138644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:21.138936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:21.139214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:21.173020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] MFA Rules not processed for user `3533bd2a4be249c488db12d3e1284eac`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:21.173020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:21.236412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1156/2301] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:21.249622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:21.307083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ae65d-3254-4325-a3c2-908c9edf6a9a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:21.310967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e114b38-c494-4594-a4d7-e089061e82f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:21.311674 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114b38-c494-4594-a4d7-e089061e82f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:21.311987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114b38-c494-4594-a4d7-e089061e82f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:21.312261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e114b38-c494-4594-a4d7-e089061e82f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:21.323109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114b38-c494-4594-a4d7-e089061e82f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:21.324738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e114b38-c494-4594-a4d7-e089061e82f0 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:21.334841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1146/2302] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:25.981233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:26.040711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb473f-13c1-41bf-b35d-7eeeb47fa829 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:26.045229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:26.046092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:26.046371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:26.046644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] PATH_INFO: `/v3/users/3533bd2a4be249c488db12d3e1284eac` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:26.047866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3533bd2a4be249c488db12d3e1284eac)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:26.050527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:26.093686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3533bd2a4be249c488db12d3e1284eac'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.094337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3533bd2a4be249c488db12d3e1284eac'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.106142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3533bd2a4be249c488db12d3e1284eac'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.113693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3533bd2a4be249c488db12d3e1284eac'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.114410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3533bd2a4be249c488db12d3e1284eac'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.126588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1157/2303] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:00:25 2022] DELETE /identity/v3/users/3533bd2a4be249c488db12d3e1284eac => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:26.131766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:26.132245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:26.132245 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:26.149317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:26.150512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:26.212123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1147/2304] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:26.222012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:26.223992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:26.280475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc729f-48c3-419c-af47-08af84e51adf admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:26.285865 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:26.286669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:26.286953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:26.287221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:26.297346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:26.299502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:26.309822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1158/2305] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:26.571121 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:26.572559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:26.586172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1f6a8-64f3-4bcc-a06b-94f860d7bd5d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:26.591624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:26.593314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:26.593608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:26.594076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] PATH_INFO: `/v3/projects/108268c0de3e42e2a61297efda6b51bb` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:26.595325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] RBAC: Authorizing `identity:delete_project(project_id=108268c0de3e42e2a61297efda6b51bb)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:26.597794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:26.642550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108268c0de3e42e2a61297efda6b51bb', 'request_id': 'req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.649434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108268c0de3e42e2a61297efda6b51bb', 'request_id': 'req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.654812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108268c0de3e42e2a61297efda6b51bb', 'request_id': 'req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.666261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] The token cache is being invalidate because project 108268c0de3e42e2a61297efda6b51bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:00:26.666553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.667223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0a13df5b-a7ae-4cf2-86d0-ce5a8149010a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:26.668919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1148/2306] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:00:26 2022] DELETE /identity/v3/projects/108268c0de3e42e2a61297efda6b51bb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:00:33.014796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:33.016208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:33.029557 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f90f0-2704-4b7f-9ae3-3c139659a59d service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:33.084099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:33.084987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:33.085273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:33.085554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] PATH_INFO: `/v3/users/7f3fbe218b1e426c9cd75a3e94820be2` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:33.086738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f3fbe218b1e426c9cd75a3e94820be2)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:33.088729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:33.141092 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f3fbe218b1e426c9cd75a3e94820be2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.141744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f3fbe218b1e426c9cd75a3e94820be2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.152837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f3fbe218b1e426c9cd75a3e94820be2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.160471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f3fbe218b1e426c9cd75a3e94820be2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.161311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f3fbe218b1e426c9cd75a3e94820be2'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.176167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1159/2307] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:00:33 2022] DELETE /identity/v3/users/7f3fbe218b1e426c9cd75a3e94820be2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:33.180654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:33.181159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:33.181462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:33.200826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:00:33.202024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:33.258554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1149/2308] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:00:33.268180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:33.269620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:33.326694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ca148-3bdb-48ec-9a81-ee32cd99f806 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:33.330393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:33.331040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:33.331328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:33.331638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:33.340471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:33.341903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:33.351715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1160/2309] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:00:33.617328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:33.618791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:33.631587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a87f2-d79a-47fc-9208-c2aeb1913fc1 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:33.636268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:33.637201 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:33.637553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:33.637890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] PATH_INFO: `/v3/projects/ac35dceb2ec34bfdb83d975ab8a245c4` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:33.639186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac35dceb2ec34bfdb83d975ab8a245c4)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:33.641371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:33.688790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac35dceb2ec34bfdb83d975ab8a245c4', 'request_id': 'req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.695991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac35dceb2ec34bfdb83d975ab8a245c4', 'request_id': 'req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.701738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac35dceb2ec34bfdb83d975ab8a245c4', 'request_id': 'req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.713860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] The token cache is being invalidate because project ac35dceb2ec34bfdb83d975ab8a245c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:00:33.714348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.715365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:00:33.717052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1150/2310] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:00:33 2022] DELETE /identity/v3/projects/ac35dceb2ec34bfdb83d975ab8a245c4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:00:46.261979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:00:46.263393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:46.373745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661076b-7dc9-4306-9e3f-f75804885804 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:00:46.430851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:00:46.431499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:00:46.431838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:00:46.432117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:00:46.433895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:00:46.444837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:00:46.446450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03fdff-7211-4dd2-8d3d-ee1c4f00244c service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:00:46.456713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1161/2311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:00:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:01:18.695083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:18.696482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:18.757372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fc4a5-9d16-4f1f-bacb-64dbdf62c8fe admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:18.761832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:18.762691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:18.762986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:18.763249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] PATH_INFO: `/v3/users/e0d8036db9d6455aaa0a25352cb6c555` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:18.764505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d8036db9d6455aaa0a25352cb6c555)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:18.766409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:18.812823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d8036db9d6455aaa0a25352cb6c555'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:18.819937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d8036db9d6455aaa0a25352cb6c555'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:18.831193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d8036db9d6455aaa0a25352cb6c555'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:18.831852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d8036db9d6455aaa0a25352cb6c555'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:18.838344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d8036db9d6455aaa0a25352cb6c555'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:18.844679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1151/2312] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:01:18 2022] DELETE /identity/v3/users/e0d8036db9d6455aaa0a25352cb6c555 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:01:18.849228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:18.849702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:18.849798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:18.866827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:18.868049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:18.924635 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1162/2313] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:18.934171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:18.936139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:18.991444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4caa6-0f46-4f72-b954-8d2ee58d8c0e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:18.995446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea45792-7399-495b-9aad-3d8361471d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:18.996123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea45792-7399-495b-9aad-3d8361471d80 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:18.996410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea45792-7399-495b-9aad-3d8361471d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:18.996692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea45792-7399-495b-9aad-3d8361471d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.006118 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea45792-7399-495b-9aad-3d8361471d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.007632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea45792-7399-495b-9aad-3d8361471d80 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.017366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1152/2314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:01:19.278387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.280441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:19.292808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b7eca-67b0-4aa0-a83e-51cb3b08dba9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.299468 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.300407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.300698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.300978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] PATH_INFO: `/v3/projects/e51e349d30f04a329ed82d69029c25fa` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.302199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51e349d30f04a329ed82d69029c25fa)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.305026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.359198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51e349d30f04a329ed82d69029c25fa', 'request_id': 'req-5daa452e-d070-458a-8bb4-b72c470d7f33'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:19.366960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51e349d30f04a329ed82d69029c25fa', 'request_id': 'req-5daa452e-d070-458a-8bb4-b72c470d7f33'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:19.374027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51e349d30f04a329ed82d69029c25fa', 'request_id': 'req-5daa452e-d070-458a-8bb4-b72c470d7f33'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:19.386876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] The token cache is being invalidate because project e51e349d30f04a329ed82d69029c25fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:01:19.387163 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:19.387976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5daa452e-d070-458a-8bb4-b72c470d7f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:01:19.389540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1163/2315] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:01:19 2022] DELETE /identity/v3/projects/e51e349d30f04a329ed82d69029c25fa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:01:19.394326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.394625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.394907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.422162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:19.423627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:19.479434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1153/2316] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:19.487702 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.488064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.488348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.506924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:19.508141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:19.516016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1164/2317] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:19.519956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.529368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1cb2d-403f-4219-bc07-265074b6b00f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.533972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.534617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.534903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.535182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.535986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:01:19.536299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.537901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.549719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1154/2318] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 16:01:19.553685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.563076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03680f7e-f116-460c-95b4-d74c0874bd27 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.567640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.568272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.568552 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.568850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.569522 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.571402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.597523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1165/2319] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:01:19 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:01:19.601588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.611494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb1cbd-563f-40c1-8b81-2dc766582060 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.668065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.668745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.669173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.669464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.670207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.672172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.694696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1155/2320] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:01:19 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:01:19.699476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.712475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932bff0-8395-4e81-a1a1-4d46abfda328 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.721105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.722248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.723022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.723245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.724358 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.726711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.737766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1166/2321] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:01:19.741753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.755761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc86a-6383-4870-84fe-2f2eed5e558d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.764253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf9788-238b-46c9-b9be-a4ce80e4fc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.764931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf9788-238b-46c9-b9be-a4ce80e4fc4d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.765212 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf9788-238b-46c9-b9be-a4ce80e4fc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.766215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf9788-238b-46c9-b9be-a4ce80e4fc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.766987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf9788-238b-46c9-b9be-a4ce80e4fc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.768621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf9788-238b-46c9-b9be-a4ce80e4fc4d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.779506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1156/2322] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:01:19.783690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.793458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b465c6-4cc2-43b4-aa68-8aef8d01ae08 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.798379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.799262 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.799577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.799863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] PATH_INFO: `/v3/projects/ceeacfc15a1f4722a8e018a2e02431a3/users/ed9411407d044cd7aa16419394f94172/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.814650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceeacfc15a1f4722a8e018a2e02431a3, user_id=ed9411407d044cd7aa16419394f94172, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:19.817344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:19.831612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1167/2323] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:01:19 2022] PUT /identity/v3/projects/ceeacfc15a1f4722a8e018a2e02431a3/users/ed9411407d044cd7aa16419394f94172/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:01:19.836721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04d9b9-6e1d-4037-b997-926f9623a940 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.837021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04d9b9-6e1d-4037-b997-926f9623a940 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.837305 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04d9b9-6e1d-4037-b997-926f9623a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:19.855067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8f04d9b9-6e1d-4037-b997-926f9623a940 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:19.856312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8f04d9b9-6e1d-4037-b997-926f9623a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:19.913899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1157/2324] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:19.924383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:19.926374 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:19.981527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e32cf-97ca-4740-a6da-52ef842feb20 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:19.985249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:19.985838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:19.986125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:19.986413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:20.003847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:20.006577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:20.018840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1168/2325] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:01:24.033794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.034354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.034354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.062761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] MFA Rules not processed for user `ed9411407d044cd7aa16419394f94172`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:24.064026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:24.131582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1158/2326] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:24.136274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:24.146288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091560e-fa90-4ac9-a89c-46451eaa671a service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:24.150915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:24.151680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.152027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.152386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.153149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:24.155779 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:24.183628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1169/2327] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:01:24 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:01:24.188585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:24.199455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3b83b-094b-47b1-9774-fcd9830fcbb0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:24.257053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:24.257724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.258012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.258293 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.259020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:24.261024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:24.282053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1159/2328] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:01:24 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:01:24.285786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:24.296212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91256c-2dfc-49b0-8cda-da5c0544f6a4 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:24.301182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:24.301862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.302157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.302608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.303606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:24.305283 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:24.317102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1170/2329] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:01:24.321376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:24.333883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4624-2c57-4fa3-b865-a8a62199d62a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:24.339817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:24.340726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.341012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.341856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] PATH_INFO: `/v3/projects/54c840db91a04b13ab249383b488ceb8/users/f587b94b25b34bcf8207fbb29caca5d6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.361174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c840db91a04b13ab249383b488ceb8, user_id=f587b94b25b34bcf8207fbb29caca5d6, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:24.363929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:24.380175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1160/2330] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:01:24 2022] PUT /identity/v3/projects/54c840db91a04b13ab249383b488ceb8/users/f587b94b25b34bcf8207fbb29caca5d6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:01:24.384161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:24.394235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9bf72-cc8f-4c95-95ab-7ff82fc3d9c2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:24.451930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99178b-5065-44dc-a8d7-ebdbf026dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:24.452603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99178b-5065-44dc-a8d7-ebdbf026dffe admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.452891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99178b-5065-44dc-a8d7-ebdbf026dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.453177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99178b-5065-44dc-a8d7-ebdbf026dffe admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.453907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99178b-5065-44dc-a8d7-ebdbf026dffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:24.455598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99178b-5065-44dc-a8d7-ebdbf026dffe admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:24.465318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1171/2331] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:01:24.470131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:24.480284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bec6-1a39-4a81-81ea-61a237834098 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:24.485420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:24.486289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:24.486575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:24.486855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] PATH_INFO: `/v3/projects/54c840db91a04b13ab249383b488ceb8/users/f587b94b25b34bcf8207fbb29caca5d6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:24.488840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c840db91a04b13ab249383b488ceb8, user_id=f587b94b25b34bcf8207fbb29caca5d6, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:24.491471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:24.501377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1161/2332] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:01:24 2022] PUT /identity/v3/projects/54c840db91a04b13ab249383b488ceb8/users/f587b94b25b34bcf8207fbb29caca5d6/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:01:29.005044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417b97-ea02-4d5e-80cc-1dd10beb2fc4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:29.006438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417b97-ea02-4d5e-80cc-1dd10beb2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:29.006846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee417b97-ea02-4d5e-80cc-1dd10beb2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:29.075884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ee417b97-ea02-4d5e-80cc-1dd10beb2fc4 None None] MFA Rules not processed for user `f587b94b25b34bcf8207fbb29caca5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:29.077439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ee417b97-ea02-4d5e-80cc-1dd10beb2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:29.174999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1172/2333] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:29.189970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:29.192556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:29.286139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f8992-e4b2-4d71-9af8-f4da9e6642e3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:29.297470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:29.298339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:29.298627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:29.298909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:29.363105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:29.364519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:29.379817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1162/2334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:01:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:01:29.507202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587f8d1-32ad-4d36-ab68-c3980f0511ee None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:29.507498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587f8d1-32ad-4d36-ab68-c3980f0511ee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:29.507820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587f8d1-32ad-4d36-ab68-c3980f0511ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:29.583979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8587f8d1-32ad-4d36-ab68-c3980f0511ee None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:29.585357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8587f8d1-32ad-4d36-ab68-c3980f0511ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:29.658034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1173/2335] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:29.708157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:29.709593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:29.806176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf0e35-3566-41f8-b477-cc1ddf483d0d service glance] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:29.811963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6f51-2f7c-41df-aa19-126c781dc71f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:29.812622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6f51-2f7c-41df-aa19-126c781dc71f service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:29.812911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6f51-2f7c-41df-aa19-126c781dc71f service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:29.813188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6f51-2f7c-41df-aa19-126c781dc71f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:29.821856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6f51-2f7c-41df-aa19-126c781dc71f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:29.823465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6f51-2f7c-41df-aa19-126c781dc71f service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:29.832017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1163/2336] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:01:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 16:01:32.863576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266967fb-9f26-4f7d-9bf9-730cfcc38803 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:32.863576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266967fb-9f26-4f7d-9bf9-730cfcc38803 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:32.864278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266967fb-9f26-4f7d-9bf9-730cfcc38803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:32.889001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-266967fb-9f26-4f7d-9bf9-730cfcc38803 None None] MFA Rules not processed for user `022067e92dd14c8bbfc712924173fb16`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:32.890821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-266967fb-9f26-4f7d-9bf9-730cfcc38803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:32.968705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1174/2337] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:39.893232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:39.893756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:39.893756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:39.911105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] MFA Rules not processed for user `ed9411407d044cd7aa16419394f94172`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:39.912369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:39.919400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1164/2338] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:41.886197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69315b-d139-4996-8a12-d2af466709fa None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:41.887822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69315b-d139-4996-8a12-d2af466709fa None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:41.888288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69315b-d139-4996-8a12-d2af466709fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:41.906902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-7e69315b-d139-4996-8a12-d2af466709fa None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:01:41.908120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7e69315b-d139-4996-8a12-d2af466709fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:01:41.915464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1175/2339] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:01:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:01:41.928162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:01:41.939511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d679b-609b-4a09-af90-4838b9b7342c None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:01:41.944540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77db09-3467-43e3-b4df-fa8b57dd1dcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:01:41.945206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77db09-3467-43e3-b4df-fa8b57dd1dcb service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:01:41.945554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77db09-3467-43e3-b4df-fa8b57dd1dcb service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:01:41.945892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77db09-3467-43e3-b4df-fa8b57dd1dcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:01:41.954614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77db09-3467-43e3-b4df-fa8b57dd1dcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:01:41.956400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77db09-3467-43e3-b4df-fa8b57dd1dcb service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:01:41.966650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1165/2340] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:02:03.188576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:03.189112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:03.189112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:03.206173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] MFA Rules not processed for user `fc9110431b1c4a919cfe4ecd7d4016dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:02:03.207370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:03.258954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1176/2341] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:02:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:02:08.292286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0dd8f-038f-4d61-ba30-ea35a4108666 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:08.292960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0dd8f-038f-4d61-ba30-ea35a4108666 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:08.292960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0dd8f-038f-4d61-ba30-ea35a4108666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:08.310423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-17e0dd8f-038f-4d61-ba30-ea35a4108666 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:02:08.311661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-17e0dd8f-038f-4d61-ba30-ea35a4108666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:08.326666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1166/2342] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:02:08.342190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:08.354957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362100a-fe88-4224-b116-c90d8ae985d4 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:08.360173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930eb0-672b-4721-8fa5-09f7ceef33e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:08.360858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930eb0-672b-4721-8fa5-09f7ceef33e0 service swift] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:08.361143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930eb0-672b-4721-8fa5-09f7ceef33e0 service swift] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:08.361422 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930eb0-672b-4721-8fa5-09f7ceef33e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:08.370153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930eb0-672b-4721-8fa5-09f7ceef33e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:08.371767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930eb0-672b-4721-8fa5-09f7ceef33e0 service swift] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:08.380810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1177/2343] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:02:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:02:30.009707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4b9b1-749e-46b5-9168-200677f4a378 None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.010352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4b9b1-749e-46b5-9168-200677f4a378 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.010352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4b9b1-749e-46b5-9168-200677f4a378 None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.012213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1167/2344] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 16:02:30.019034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633806f7-bb8a-4a92-9b08-e5eab420660f None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.019572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633806f7-bb8a-4a92-9b08-e5eab420660f None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.019572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633806f7-bb8a-4a92-9b08-e5eab420660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.069253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-633806f7-bb8a-4a92-9b08-e5eab420660f None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:02:30.070453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-633806f7-bb8a-4a92-9b08-e5eab420660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:30.145058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1178/2345] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:02:30.157046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4b9b1-749e-46b5-9168-200677f4a378 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:30.167383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4b9b1-749e-46b5-9168-200677f4a378 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:30.171056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a08b25-e219-41aa-81f5-c970664412b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:30.171705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a08b25-e219-41aa-81f5-c970664412b2 service glance] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.171985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a08b25-e219-41aa-81f5-c970664412b2 service glance] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.172256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a08b25-e219-41aa-81f5-c970664412b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.182233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a08b25-e219-41aa-81f5-c970664412b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:30.183662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a08b25-e219-41aa-81f5-c970664412b2 service glance] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:30.193757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1168/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:30.262745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f879-5947-4f4d-8811-e52321827a2e None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.263032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f879-5947-4f4d-8811-e52321827a2e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.263385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50f879-5947-4f4d-8811-e52321827a2e None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.265402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1179/2347] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 16:02:30.271228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa15d7-7ad1-4184-9afc-7201127fd3e0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.271511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa15d7-7ad1-4184-9afc-7201127fd3e0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.271904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa15d7-7ad1-4184-9afc-7201127fd3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.292721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a0fa15d7-7ad1-4184-9afc-7201127fd3e0 None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:02:30.294551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a0fa15d7-7ad1-4184-9afc-7201127fd3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:30.345223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1169/2348] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:02:30.357642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f879-5947-4f4d-8811-e52321827a2e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:30.368272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50f879-5947-4f4d-8811-e52321827a2e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:30.371764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfba376-033a-45c1-8f63-aa85fac9e5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:30.372390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfba376-033a-45c1-8f63-aa85fac9e5de service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.372675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfba376-033a-45c1-8f63-aa85fac9e5de service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.372952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfba376-033a-45c1-8f63-aa85fac9e5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.379920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfba376-033a-45c1-8f63-aa85fac9e5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:30.381351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfba376-033a-45c1-8f63-aa85fac9e5de service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:30.388809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1180/2349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:30.478038 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a9f07-c752-4212-9373-e8cabe12f1fc None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.478357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a9f07-c752-4212-9373-e8cabe12f1fc None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.478639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a9f07-c752-4212-9373-e8cabe12f1fc None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.480449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1170/2350] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 16:02:30.485972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.486369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.486699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.505303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:02:30.506534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:30.516420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1181/2351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 16:02:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:02:30.526848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a9f07-c752-4212-9373-e8cabe12f1fc None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:30.537688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a9f07-c752-4212-9373-e8cabe12f1fc None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:30.541859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6a977-0d64-4859-b8e4-cd537a147edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:30.542496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a977-0d64-4859-b8e4-cd537a147edd service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:30.542807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a977-0d64-4859-b8e4-cd537a147edd service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:30.543088 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6a977-0d64-4859-b8e4-cd537a147edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:30.553524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6a977-0d64-4859-b8e4-cd537a147edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:30.554945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6a977-0d64-4859-b8e4-cd537a147edd service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:30.565430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1171/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:32.936901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:32.946646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e364b3-fb82-4aa8-bd0c-56b35ed012f8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:32.950195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:32.950857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:32.951139 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:32.951412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:32.960617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:32.962641 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:32.972553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1182/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:34.662010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:34.662490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:34.662580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:34.680829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:02:34.682025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:34.689301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1172/2354] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:02:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:02:34.712606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:34.723897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253544c0-1a05-4752-8d75-a2185f28f2c5 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:34.729725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:34.730363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:34.730650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:34.730932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:34.739320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:34.740985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:34.749373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1183/2355] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:02:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:02:40.999016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:41.008738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c53fe-9054-4369-8969-07b7c4d32f66 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:41.012989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:41.013671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:41.013956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:41.014263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:41.016170 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:41.037663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:41.040087 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:41.057936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1173/2356] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:41.489342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:41.491795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:41.504052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd4cc7-d345-42a2-9da6-220fe56f58f0 service swift] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:41.507956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:41.508675 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:41.509208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:41.509555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:41.511643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:41.526487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:41.527989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:41.540401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1184/2357] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:49.716936 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:49.718543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:49.733399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c4950-b463-4a41-81d8-14a39152511b service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:49.739393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:49.740135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:49.740491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:49.740915 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:49.743431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:49.816271 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:49.817913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:49.827885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1174/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:02:54.200897 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:54.202333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:54.215872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa0aa2-2e52-4405-958c-d44fabfc9a93 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:54.221291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:54.221917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:54.222202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:54.222483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:54.224196 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:54.283651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:54.285279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f995284-2fe0-48de-8076-cbc5eaf985a3 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:54.297412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1185/2359] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:02:58.870308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:02:58.880131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cc8e6-266e-4eec-a1f5-ede3af8c299c service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:02:58.884435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:02:58.885197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:02:58.885579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:02:58.885919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:02:58.887828 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:02:58.898063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:02:58.899730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:02:58.909076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1175/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:02:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:03:07.590962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:07.591458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:07.591573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:07.608730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:03:07.609939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:07.617599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1186/2361] 10.222.0.23 () {58 vars in 967 bytes} [Tue Mar 29 16:03:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:03:07.630362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:07.642162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbb46b-60f3-4f81-9f3f-d87df930f026 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:07.647691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:07.648326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:07.648613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:07.649029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:07.657133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:07.658898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:07.667280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1176/2362] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:03:17.532668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:17.534242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:17.597957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eee11-e42d-4b5f-a0c9-6e8a434530ca None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:17.602966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:17.603859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:17.604147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:17.604420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] PATH_INFO: `/v3/users/022067e92dd14c8bbfc712924173fb16` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:17.605593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=022067e92dd14c8bbfc712924173fb16)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:17.607520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:17.649993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022067e92dd14c8bbfc712924173fb16'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.650626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022067e92dd14c8bbfc712924173fb16'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.661581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022067e92dd14c8bbfc712924173fb16'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.668572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022067e92dd14c8bbfc712924173fb16'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.669289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-38bc4519-12ec-4c8a-a8a9-bed2c7bb8864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022067e92dd14c8bbfc712924173fb16'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.681115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1187/2363] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:03:17 2022] DELETE /identity/v3/users/022067e92dd14c8bbfc712924173fb16 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:03:17.850417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:17.862419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b85027-2fef-4957-8da4-4bfadc4d4574 service swift] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:17.920878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:17.921865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:17.922221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:17.922613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] PATH_INFO: `/v3/projects/a0baed6aa16444c79fcf1f2183b2d768` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:17.923947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0baed6aa16444c79fcf1f2183b2d768)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:17.925863 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:17.971948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0baed6aa16444c79fcf1f2183b2d768', 'request_id': 'req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.980223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0baed6aa16444c79fcf1f2183b2d768', 'request_id': 'req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.986352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0baed6aa16444c79fcf1f2183b2d768', 'request_id': 'req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.997196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] The token cache is being invalidate because project a0baed6aa16444c79fcf1f2183b2d768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:03:17.997487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.998120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c33af8f3-42b2-4ee0-bcf6-7e338485f2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:17.999669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1177/2364] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:03:17 2022] DELETE /identity/v3/projects/a0baed6aa16444c79fcf1f2183b2d768 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:03:18.004428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.004813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.005698 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.022787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:03:18.024040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:18.083519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1188/2365] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:03:18.090804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.091098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.091417 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.111008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:03:18.112238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:18.120716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1178/2366] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:03:18.124784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.134941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8216c9f-f698-4d86-a03a-2a237330b9c0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.139858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bffd08-3392-417f-abda-418557248875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.140657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bffd08-3392-417f-abda-418557248875 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.140958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bffd08-3392-417f-abda-418557248875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.141233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bffd08-3392-417f-abda-418557248875 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.141955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bffd08-3392-417f-abda-418557248875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:03:18.142260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bffd08-3392-417f-abda-418557248875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.143906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bffd08-3392-417f-abda-418557248875 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.155940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1189/2367] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:03:18.160318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.170129 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bade0-23fa-41e9-97d0-9d5bde3f9fbf None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.174726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.175366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.175679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.175962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.176679 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.178590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.203721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1179/2368] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:03:18 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:03:18.207793 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bffd08-3392-417f-abda-418557248875 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.218316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bffd08-3392-417f-abda-418557248875 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.274549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.275216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.275498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.275802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.276486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.278486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.301200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1190/2369] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:03:18 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:03:18.305396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.315308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f7408-a91e-4c6b-83da-d83b5af226c6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.319963 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.320611 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.320898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.321177 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.321904 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.323499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.334076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1180/2370] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:03:18.337780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.347307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a926ea-1870-4415-a4ec-6734ec591aba admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.352527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f0b89-efcd-48af-8945-840232d844ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.353200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f0b89-efcd-48af-8945-840232d844ef admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.353483 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f0b89-efcd-48af-8945-840232d844ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.353758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f0b89-efcd-48af-8945-840232d844ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.354493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f0b89-efcd-48af-8945-840232d844ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.356109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f0b89-efcd-48af-8945-840232d844ef admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.365517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1191/2371] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:03:18.369357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.378774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c047c-8107-4339-8cb1-50804843bd37 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.383275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.384146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.384426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.384698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] PATH_INFO: `/v3/projects/8fc4fba7223f4f7dbd94578f5722a6e9/users/5c0e14ce854c44e888c6d0b7d5e117ab/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.399427 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc4fba7223f4f7dbd94578f5722a6e9, user_id=5c0e14ce854c44e888c6d0b7d5e117ab, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.402182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.415154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1181/2372] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:03:18 2022] PUT /identity/v3/projects/8fc4fba7223f4f7dbd94578f5722a6e9/users/5c0e14ce854c44e888c6d0b7d5e117ab/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:03:18.425118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25b8a-ae64-43fe-a576-bd3a0958b4e1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.425516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25b8a-ae64-43fe-a576-bd3a0958b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.425798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c25b8a-ae64-43fe-a576-bd3a0958b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.451180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-72c25b8a-ae64-43fe-a576-bd3a0958b4e1 None None] MFA Rules not processed for user `5c0e14ce854c44e888c6d0b7d5e117ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:03:18.452410 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-72c25b8a-ae64-43fe-a576-bd3a0958b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:18.512677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1192/2373] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:03:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:03:18.523795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:18.525465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:18.600344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457466f-55e7-4f5b-b483-a7eb04580411 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:18.603886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:18.604516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:18.604798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:18.605072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:18.613044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:18.615029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:18.623466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1182/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:03:19.171335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:19.171872 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:19.171969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:19.189054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] MFA Rules not processed for user `6ecde8d802f04ab7bde761e9a0e6b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:03:19.190301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:19.242161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1193/2375] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:03:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:03:32.476054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:32.477574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:32.556871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaca67-da42-4059-9228-6d0020b85ad4 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:32.562316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:32.562962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:32.563248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:32.563550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:32.565446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:32.577773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:32.579374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534526ce-dfa2-454a-85cc-19d56aee19d4 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:32.590140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1183/2376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:03:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:03:40.810541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:40.869186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e39081-98a2-4e55-9a6f-58ba96533de7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:40.873622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:40.874480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:40.874762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:40.875040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] PATH_INFO: `/v3/users/5c0e14ce854c44e888c6d0b7d5e117ab` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:40.876218 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0e14ce854c44e888c6d0b7d5e117ab)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:40.878142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:40.920960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0e14ce854c44e888c6d0b7d5e117ab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:40.921611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0e14ce854c44e888c6d0b7d5e117ab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:40.933212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0e14ce854c44e888c6d0b7d5e117ab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:40.940279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0e14ce854c44e888c6d0b7d5e117ab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:40.940982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0e14ce854c44e888c6d0b7d5e117ab'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:40.953042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1194/2377] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:03:40 2022] DELETE /identity/v3/users/5c0e14ce854c44e888c6d0b7d5e117ab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:03:40.957479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:40.958002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:40.958002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:40.974400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:03:40.975500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:41.031768 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1184/2378] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:03:41.041935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:41.043678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:41.099443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d200af-5d6d-4aa1-8ecd-51b8706c83e3 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:41.103024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:41.103711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:41.103996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:41.104297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:41.112992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:41.114420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:41.123624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1195/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:03:41.390384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:03:41.391882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:03:41.404325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51cf01-7fe4-4015-ab22-e30bf7d186f0 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:03:41.409366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:03:41.410259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:03:41.410543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:03:41.410814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] PATH_INFO: `/v3/projects/8fc4fba7223f4f7dbd94578f5722a6e9` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:03:41.412044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc4fba7223f4f7dbd94578f5722a6e9)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:03:41.413945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:03:41.468465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc4fba7223f4f7dbd94578f5722a6e9', 'request_id': 'req-2340667d-ccf7-44a0-bc26-fcd1c706c209'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:41.475586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc4fba7223f4f7dbd94578f5722a6e9', 'request_id': 'req-2340667d-ccf7-44a0-bc26-fcd1c706c209'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:41.480882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc4fba7223f4f7dbd94578f5722a6e9', 'request_id': 'req-2340667d-ccf7-44a0-bc26-fcd1c706c209'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:41.492186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] The token cache is being invalidate because project 8fc4fba7223f4f7dbd94578f5722a6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:03:41.492478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:41.493114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2340667d-ccf7-44a0-bc26-fcd1c706c209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:03:41.494647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1185/2380] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:03:41 2022] DELETE /identity/v3/projects/8fc4fba7223f4f7dbd94578f5722a6e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:04:17.145730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:17.147151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:17.226164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1bcf7-84f1-4963-83b2-53d4447e929e service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:17.300021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:17.301005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:17.301436 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:17.301875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:17.304049 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:17.366062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:17.367875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:17.378346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1196/2381] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:24.917300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:24.917876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:24.917876 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:24.935516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] MFA Rules not processed for user `23a85c0f0bff4056af1d8f6691da236c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:24.936766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:24.991950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1186/2382] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:25.309924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:25.311376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:25.368393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979be29d-20c6-48e9-a90e-8808db2ce384 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:25.372095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:25.372738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:25.373027 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:25.373301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:25.375057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:25.385440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:25.387021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a18fa-8cc4-45ad-ad2f-8b9cdc02049d service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:25.395926 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1197/2383] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:04:26.724306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:26.725721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:26.795615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da200a-f8dc-4073-b564-971a42ff28c9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:26.800566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:26.801214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:26.801501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:26.801783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:26.803551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:26.815076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:26.816689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:26.826165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1187/2384] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:32.178837 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:32.179727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:32.180058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:32.204907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] MFA Rules not processed for user `fc9110431b1c4a919cfe4ecd7d4016dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:32.206133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:32.215696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1198/2385] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:32.522536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:32.523883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:32.535499 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464433f6-68a1-4306-952c-faba80db55c1 service placement] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:32.539041 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:32.539766 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:32.540054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:32.540579 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:32.542268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:32.551140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:32.552604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:32.560452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1188/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:36.589047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:36.591268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:36.612384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8394d-511a-46f4-a507-9b8ec7da8bbf None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:36.618091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:36.618764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:36.619058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:36.619331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:36.621360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:36.638291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:36.640404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:36.653796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1199/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:46.462447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:46.471235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf9a44-988f-4853-ba78-8f0312a051a4 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:46.476243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:46.477159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:46.477720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:46.478214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:46.481621 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:46.543651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:46.545092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:46.555057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1189/2388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:49.888051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:49.889524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:49.909531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9d599-e305-453e-bca4-feb6e3e40995 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:49.915112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:49.916101 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:49.916386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:49.916656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] PATH_INFO: `/v3/users/6ecde8d802f04ab7bde761e9a0e6b6d4` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:49.917838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ecde8d802f04ab7bde761e9a0e6b6d4)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:49.919788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:49.964255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ecde8d802f04ab7bde761e9a0e6b6d4'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:49.964925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ecde8d802f04ab7bde761e9a0e6b6d4'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:49.976165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ecde8d802f04ab7bde761e9a0e6b6d4'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:49.983424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ecde8d802f04ab7bde761e9a0e6b6d4'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:49.984082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-485102c7-e536-4879-98ff-1be4ba1b6dcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ecde8d802f04ab7bde761e9a0e6b6d4'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:49.995783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1200/2389] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:04:49 2022] DELETE /identity/v3/users/6ecde8d802f04ab7bde761e9a0e6b6d4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:04:50.163426 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.173946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb34d3-df22-4306-9525-2335c6cebd9c service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.231670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.232530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.232842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.233634 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] PATH_INFO: `/v3/projects/1048ec44b09a4fceb22ea03497bac371` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.234801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1048ec44b09a4fceb22ea03497bac371)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.236748 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.281449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1048ec44b09a4fceb22ea03497bac371', 'request_id': 'req-44c42fb9-4051-4855-86f8-a5cf4f79ade1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:50.288400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1048ec44b09a4fceb22ea03497bac371', 'request_id': 'req-44c42fb9-4051-4855-86f8-a5cf4f79ade1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:50.293882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1048ec44b09a4fceb22ea03497bac371', 'request_id': 'req-44c42fb9-4051-4855-86f8-a5cf4f79ade1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:50.304787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] The token cache is being invalidate because project 1048ec44b09a4fceb22ea03497bac371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:04:50.305080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:50.305714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-44c42fb9-4051-4855-86f8-a5cf4f79ade1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:04:50.307247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1190/2390] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:04:50 2022] DELETE /identity/v3/projects/1048ec44b09a4fceb22ea03497bac371 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:04:50.312199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.312488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.312766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.329541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:50.330717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:50.385499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1201/2391] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:50.393826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.394126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.394411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.413280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:50.414496 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:50.422638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1191/2392] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:50.426835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.441604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746c6dd-c825-4650-baca-a2d013ae2245 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.447289 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.447984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.448271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.448553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.449739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:04:50.450246 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.452532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.464282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1202/2393] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:04:50.469149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.478234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61944e74-2571-45b0-8ca1-0760bc9a3ae3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.483398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.484203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.484539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.484817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.485509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.487422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.521026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1192/2394] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:04:50 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:04:50.525104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.534842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6a84b-ec56-4e2f-82b4-b916ecd29c4f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.587467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.588146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.588427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.588728 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.589412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.591326 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.609744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1203/2395] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:04:50 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:04:50.613891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.624397 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e2e42-6d3c-4096-a813-8d0d501c8127 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.629070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.629747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.630028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.630302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.631013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.632659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.642178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1193/2396] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:04:50.645756 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.655099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417958f-f092-4542-87ef-9a68061dc691 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.659578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f562e-4d81-47a5-8779-2be0d05dd4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.660212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f562e-4d81-47a5-8779-2be0d05dd4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.660492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f562e-4d81-47a5-8779-2be0d05dd4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.660762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f562e-4d81-47a5-8779-2be0d05dd4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.661471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f562e-4d81-47a5-8779-2be0d05dd4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.663036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f562e-4d81-47a5-8779-2be0d05dd4bd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.673153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1204/2397] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:04:50.676994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.687234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ad408-9fe0-421c-8ac6-aeb3186cef66 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.691841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.692721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.692989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.693294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] PATH_INFO: `/v3/projects/42076e0f315f45bfa46a75434188626f/users/fd393753fd81497391a83b42cae7e1c8/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.707143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42076e0f315f45bfa46a75434188626f, user_id=fd393753fd81497391a83b42cae7e1c8, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.709796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.722264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1194/2398] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:04:50 2022] PUT /identity/v3/projects/42076e0f315f45bfa46a75434188626f/users/fd393753fd81497391a83b42cae7e1c8/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:04:50.727272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c275c-63b4-4462-91b9-90690fef37c9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.727604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c275c-63b4-4462-91b9-90690fef37c9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.727888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c275c-63b4-4462-91b9-90690fef37c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.745735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-854c275c-63b4-4462-91b9-90690fef37c9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:50.746938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-854c275c-63b4-4462-91b9-90690fef37c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:50.806685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1205/2399] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:50.816296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:50.818060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:50.874874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e618a31-e004-40f0-88c3-01295b15a007 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:50.878511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:50.879155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:50.879439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:50.879816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:50.889261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:50.890706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:50.900596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1195/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:54.837433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0c3b-359c-41a0-91e5-ff7a5d7c3fd6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:54.837903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0c3b-359c-41a0-91e5-ff7a5d7c3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:54.837999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0c3b-359c-41a0-91e5-ff7a5d7c3fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:54.872143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-79ce0c3b-359c-41a0-91e5-ff7a5d7c3fd6 None None] MFA Rules not processed for user `fd393753fd81497391a83b42cae7e1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:54.875428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-79ce0c3b-359c-41a0-91e5-ff7a5d7c3fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:54.963235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1206/2401] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:54.974694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:54.976222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:55.063168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595d8a-85aa-449b-bc78-98e0fd124842 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:55.071409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:55.072150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:55.072487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:55.072715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:55.083709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:55.085318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:55.097445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1196/2402] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:04:56.588062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff363e4c-e22b-49c0-b7ab-1c11df161fc0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:56.588651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff363e4c-e22b-49c0-b7ab-1c11df161fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:56.588651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff363e4c-e22b-49c0-b7ab-1c11df161fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:56.606670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ff363e4c-e22b-49c0-b7ab-1c11df161fc0 None None] MFA Rules not processed for user `fd393753fd81497391a83b42cae7e1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:04:56.607940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ff363e4c-e22b-49c0-b7ab-1c11df161fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:56.615017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1207/2403] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:04:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:04:59.926897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:04:59.929750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:59.954850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e431d6d-f9b8-4441-9fee-cecb7c6e51aa service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:04:59.961193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:04:59.961783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:04:59.962071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:04:59.962404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:04:59.964281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:04:59.977741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:04:59.979335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:04:59.991063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1197/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:04:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:05:44.960543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:44.961007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:44.961107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:44.978671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:05:44.979893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:45.032039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1208/2405] 10.222.0.23 () {58 vars in 967 bytes} [Tue Mar 29 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:05:45.078935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:05:45.080369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:45.148392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074e549-dd13-4cd9-b064-5a494f6b87a8 service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:05:45.153354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:05:45.154000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:45.154288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:45.155132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:45.164082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:05:45.165775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:05:45.174279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1198/2406] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:05:48.875420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:05:48.876901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:48.955560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58358-8ea2-4bff-86bb-62d9d35517df None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:05:48.960491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:05:48.961143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:48.961426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:48.961706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:48.963467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:48.974975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:05:48.976646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:05:48.987030 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1209/2407] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:05:52.154602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:05:52.156100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:52.170192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd976-0b47-4ab9-bdf0-e1ecb103f450 service swift] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:05:52.174669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:05:52.175572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:52.175865 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:52.176142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] PATH_INFO: `/v3/users/ed9411407d044cd7aa16419394f94172` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:52.177366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed9411407d044cd7aa16419394f94172)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:05:52.179288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:05:52.224227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed9411407d044cd7aa16419394f94172'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.231479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed9411407d044cd7aa16419394f94172'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.243355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed9411407d044cd7aa16419394f94172'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.244058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed9411407d044cd7aa16419394f94172'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.251464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed9411407d044cd7aa16419394f94172'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.257344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1199/2408] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:05:52 2022] DELETE /identity/v3/users/ed9411407d044cd7aa16419394f94172 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:05:52.426660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:05:52.437331 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2439012-9e57-41ac-8219-6fcb50e4f5e9 service placement] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:05:52.501450 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:05:52.502304 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:52.502583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:52.502853 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] PATH_INFO: `/v3/projects/ceeacfc15a1f4722a8e018a2e02431a3` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:52.504061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceeacfc15a1f4722a8e018a2e02431a3)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:05:52.505975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:05:52.554173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceeacfc15a1f4722a8e018a2e02431a3', 'request_id': 'req-448c4bea-d6f9-41c0-8746-ea573afbc0a1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.560107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceeacfc15a1f4722a8e018a2e02431a3', 'request_id': 'req-448c4bea-d6f9-41c0-8746-ea573afbc0a1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.565209 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceeacfc15a1f4722a8e018a2e02431a3', 'request_id': 'req-448c4bea-d6f9-41c0-8746-ea573afbc0a1'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.577856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] The token cache is being invalidate because project ceeacfc15a1f4722a8e018a2e02431a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:05:52.578142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.578791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.580478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1210/2409] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:05:52 2022] DELETE /identity/v3/projects/ceeacfc15a1f4722a8e018a2e02431a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:05:52.585050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:05:52.586453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:52.599571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041060-79eb-4723-be08-54a4620c33dc admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:05:52.651992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:05:52.652875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:52.653174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:52.653453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] PATH_INFO: `/v3/users/f587b94b25b34bcf8207fbb29caca5d6` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:52.655248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f587b94b25b34bcf8207fbb29caca5d6)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:05:52.657248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:05:52.702741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f587b94b25b34bcf8207fbb29caca5d6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.710524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f587b94b25b34bcf8207fbb29caca5d6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.722784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f587b94b25b34bcf8207fbb29caca5d6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.723445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f587b94b25b34bcf8207fbb29caca5d6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.730225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-a9effdf3-d499-4982-a6af-f8732d32665c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f587b94b25b34bcf8207fbb29caca5d6'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:52.736826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1200/2410] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:05:52 2022] DELETE /identity/v3/users/f587b94b25b34bcf8207fbb29caca5d6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:05:52.910351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:05:52.912500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:05:52.927256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c4bea-d6f9-41c0-8746-ea573afbc0a1 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:05:52.992973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:05:52.993867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:05:52.994152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:05:52.994431 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] PATH_INFO: `/v3/projects/54c840db91a04b13ab249383b488ceb8` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:05:52.995650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c840db91a04b13ab249383b488ceb8)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:05:52.997637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:05:53.042070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c840db91a04b13ab249383b488ceb8', 'request_id': 'req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:53.048594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c840db91a04b13ab249383b488ceb8', 'request_id': 'req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:53.054242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c840db91a04b13ab249383b488ceb8', 'request_id': 'req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:53.067056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] The token cache is being invalidate because project 54c840db91a04b13ab249383b488ceb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:05:53.067346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:53.068006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9b2bb70c-8962-4b47-8596-fb21bb43e3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:05:53.069561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1211/2411] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:05:52 2022] DELETE /identity/v3/projects/54c840db91a04b13ab249383b488ceb8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:06:18.198491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e0483-2a76-4893-a716-508110144460 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:18.199586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e0483-2a76-4893-a716-508110144460 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:18.199706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e0483-2a76-4893-a716-508110144460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:18.217408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c16e0483-2a76-4893-a716-508110144460 None None] MFA Rules not processed for user `fc9110431b1c4a919cfe4ecd7d4016dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:06:18.218593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c16e0483-2a76-4893-a716-508110144460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:18.270081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1201/2412] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:06:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:06:27.995719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9defb45-8892-4556-98f9-c99eec4acab7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:27.996239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9defb45-8892-4556-98f9-c99eec4acab7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:27.996340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9defb45-8892-4556-98f9-c99eec4acab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:28.016785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a9defb45-8892-4556-98f9-c99eec4acab7 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:06:28.017990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a9defb45-8892-4556-98f9-c99eec4acab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:28.081370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1212/2413] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:06:28.094189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e0483-2a76-4893-a716-508110144460 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:06:28.095704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c16e0483-2a76-4893-a716-508110144460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:28.168930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e0483-2a76-4893-a716-508110144460 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:06:28.174207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648cff2-99ca-4dbc-948d-af287b199191 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:06:28.174978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648cff2-99ca-4dbc-948d-af287b199191 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:28.175332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648cff2-99ca-4dbc-948d-af287b199191 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:28.175654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648cff2-99ca-4dbc-948d-af287b199191 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:28.188182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648cff2-99ca-4dbc-948d-af287b199191 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:06:28.189379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e648cff2-99ca-4dbc-948d-af287b199191 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:06:28.198162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1202/2414] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:06:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 16:06:43.013964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dece89-6262-4f27-bb68-75e856dfe298 None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.014577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dece89-6262-4f27-bb68-75e856dfe298 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.014577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dece89-6262-4f27-bb68-75e856dfe298 None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.016366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1213/2415] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 16:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 16:06:43.022535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee442d-a63f-45fd-9021-5370cd42299f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.023029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee442d-a63f-45fd-9021-5370cd42299f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.023137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee442d-a63f-45fd-9021-5370cd42299f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.042586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-56ee442d-a63f-45fd-9021-5370cd42299f None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:06:43.043821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-56ee442d-a63f-45fd-9021-5370cd42299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:43.110577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1203/2416] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:06:43.123438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dece89-6262-4f27-bb68-75e856dfe298 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:06:43.125396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-84dece89-6262-4f27-bb68-75e856dfe298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:43.180678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dece89-6262-4f27-bb68-75e856dfe298 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:06:43.184786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd014d-a1c2-40ad-b53b-6c93fd72651f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:06:43.185520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd014d-a1c2-40ad-b53b-6c93fd72651f service glance] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.185801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd014d-a1c2-40ad-b53b-6c93fd72651f service glance] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.186073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd014d-a1c2-40ad-b53b-6c93fd72651f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.195886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd014d-a1c2-40ad-b53b-6c93fd72651f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:06:43.197343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd014d-a1c2-40ad-b53b-6c93fd72651f service glance] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:06:43.207451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1214/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:06:43.272347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64909eb-b67a-4b79-98e8-c0562dc9a72b None None] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.272643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64909eb-b67a-4b79-98e8-c0562dc9a72b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.272930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64909eb-b67a-4b79-98e8-c0562dc9a72b None None] PATH_INFO: `/` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.274737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1204/2418] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 16:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 16:06:43.279761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b382f-76ee-4855-bd8a-f3803a19ce72 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.280055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b382f-76ee-4855-bd8a-f3803a19ce72 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.280335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b382f-76ee-4855-bd8a-f3803a19ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.298600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f71b382f-76ee-4855-bd8a-f3803a19ce72 None None] MFA Rules not processed for user `aa8ff0744fac48fd8dca772e998701ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:06:43.299850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f71b382f-76ee-4855-bd8a-f3803a19ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:43.348754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1215/2419] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:06:43.360713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64909eb-b67a-4b79-98e8-c0562dc9a72b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:06:43.362423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d64909eb-b67a-4b79-98e8-c0562dc9a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:43.375119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64909eb-b67a-4b79-98e8-c0562dc9a72b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:06:43.378884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bb898-1d30-49fd-8671-1601738fb133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:06:43.379515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb898-1d30-49fd-8671-1601738fb133 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.379841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb898-1d30-49fd-8671-1601738fb133 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.380339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb898-1d30-49fd-8671-1601738fb133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.391639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bb898-1d30-49fd-8671-1601738fb133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:06:43.393070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bb898-1d30-49fd-8671-1601738fb133 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:06:43.401102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1205/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:06:43.501368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d9ba-95e9-4efe-8385-1e3892032cbd None None] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.501804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d9ba-95e9-4efe-8385-1e3892032cbd None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.502190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d9ba-95e9-4efe-8385-1e3892032cbd None None] PATH_INFO: `/` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.504208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1216/2421] 10.222.0.23 () {54 vars in 921 bytes} [Tue Mar 29 16:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 29 16:06:43.511931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0a117-e2fa-43e4-8ec9-1ca71965b561 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.512335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0a117-e2fa-43e4-8ec9-1ca71965b561 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.512747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0a117-e2fa-43e4-8ec9-1ca71965b561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.530894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-20d0a117-e2fa-43e4-8ec9-1ca71965b561 None None] MFA Rules not processed for user `ba546b8ade2443a096e7f303d609b622`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:06:43.532103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-20d0a117-e2fa-43e4-8ec9-1ca71965b561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:43.542076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1206/2422] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Mar 29 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:06:43.552544 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293d9ba-95e9-4efe-8385-1e3892032cbd None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:06:43.554312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8293d9ba-95e9-4efe-8385-1e3892032cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:43.570940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293d9ba-95e9-4efe-8385-1e3892032cbd None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:06:43.574691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:06:43.575416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:43.575913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:43.576270 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:43.587412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:06:43.588915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:06:43.599947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1217/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:06:45.256585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1093d-f72e-40ba-9edb-6dffa922e989 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:45.257135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1093d-f72e-40ba-9edb-6dffa922e989 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:45.257135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1093d-f72e-40ba-9edb-6dffa922e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:45.274773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-03d1093d-f72e-40ba-9edb-6dffa922e989 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:06:45.276597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-03d1093d-f72e-40ba-9edb-6dffa922e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:06:45.283616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1207/2424] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:06:45.304673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:06:45.315406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9a474-11d1-41ca-a7f2-e20603e18931 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:06:45.320424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:06:45.321050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:06:45.321335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:06:45.321614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:06:45.330618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:06:45.331759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:06:45.340368 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1218/2425] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 16:07:02.884066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:07:02.884535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:07:02.884633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:07:02.902053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:07:02.903223 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:07:02.910430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1208/2426] 10.222.0.23 () {58 vars in 967 bytes} [Tue Mar 29 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:07:02.923173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:07:02.933369 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201aae-9ec9-4864-a19e-7469dad4c85d service swift] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:07:02.938313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:07:02.938949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:07:02.939237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:07:02.939521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:07:02.947454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:07:02.949072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:07:02.957287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1219/2427] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:07:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:07:50.018613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:07:50.019958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:07:50.073943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c7b2-0dbf-4a77-8619-5ab8415d0ab1 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:07:50.077515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:07:50.078158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:07:50.078438 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:07:50.079240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:07:50.080985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:07:50.093666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:07:50.095082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:07:50.105515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1209/2428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:07:57.938791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:07:57.940315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:07:57.952844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721acb59-ca5e-4cb8-93da-28f64d49b430 service swift] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:07:57.958869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:07:57.959551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:07:57.960008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:07:57.960302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:07:57.962111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:07:57.976547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:07:57.977995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:07:57.989810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1220/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:07:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:07:58.112900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:07:58.122469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b021a48-acb3-4035-a234-90ece7f7571d service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:07:58.126280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:07:58.126921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:07:58.127504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:07:58.127992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:07:58.130344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:07:58.141186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:07:58.142620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:07:58.151767 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1210/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:07:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:07.402077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:07.411748 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad86cb-1784-4719-a70c-915fece008a1 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:07.415744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:07.416383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:07.416662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:07.416947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:07.418716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:07.481930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:07.483381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:07.494851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1221/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:09.299910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:09.309558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3527-d714-49fa-83cb-003cf79e1b02 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:09.313220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:09.313856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:09.314142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:09.314795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:09.316580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:09.404596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:09.406153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:09.431183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1211/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:10.953277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:10.956821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:10.973586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7202e7-0769-43cb-84ec-0180ec6a153d service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:10.978782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:10.979737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:10.980025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:10.980305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] PATH_INFO: `/v3/users/fc9110431b1c4a919cfe4ecd7d4016dd` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:10.997132 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9110431b1c4a919cfe4ecd7d4016dd)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:10.999408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.056833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9110431b1c4a919cfe4ecd7d4016dd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.057537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9110431b1c4a919cfe4ecd7d4016dd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.070044 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9110431b1c4a919cfe4ecd7d4016dd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.077611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9110431b1c4a919cfe4ecd7d4016dd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.078250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2e92d14a-d6b0-45f7-b2b4-7a196183c590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9110431b1c4a919cfe4ecd7d4016dd'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.090930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1222/2433] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:10 2022] DELETE /identity/v3/users/fc9110431b1c4a919cfe4ecd7d4016dd => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:11.256973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.268420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773f268-6e56-431c-92e4-581ef98777b0 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.324493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.325349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.325635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.325914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] PATH_INFO: `/v3/projects/7e1b85555d1347f99e15d588f33948bc` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.336375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1b85555d1347f99e15d588f33948bc)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.338291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.381642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1b85555d1347f99e15d588f33948bc', 'request_id': 'req-6a244cf9-5b62-4cb8-bd71-702568b832bc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.390176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1b85555d1347f99e15d588f33948bc', 'request_id': 'req-6a244cf9-5b62-4cb8-bd71-702568b832bc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.395558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1b85555d1347f99e15d588f33948bc', 'request_id': 'req-6a244cf9-5b62-4cb8-bd71-702568b832bc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.407311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] The token cache is being invalidate because project 7e1b85555d1347f99e15d588f33948bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:11.407624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.408345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6a244cf9-5b62-4cb8-bd71-702568b832bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:11.410125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1212/2434] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:11 2022] DELETE /identity/v3/projects/7e1b85555d1347f99e15d588f33948bc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:11.415429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.415821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.416168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.433823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:11.435098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:11.497133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1223/2435] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:11.505384 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.505703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.505984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.523973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:11.525153 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:11.533047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1213/2436] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:11.538295 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.548273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bce202-35c3-4908-a825-bf34a266b9ed None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.552851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.553509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.553796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.554059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.554816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:11.555118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.556984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.572090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1224/2437] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:11.573215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.582287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28b13f-5215-4b09-b7d7-1656415ea989 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.587355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.588028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.588311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.588585 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.589266 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.591150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.620694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1214/2438] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:11 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:08:11.621857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.632171 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b27a0-bf84-4593-9d67-02bb47bebfde admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.687873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.688539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.688825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.689100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.689780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.691722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.712254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1225/2439] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:11 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:08:11.716473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.726720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb2b3e-2422-4c71-a44b-a7ccd889793e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.731328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.732028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.732318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.732597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.733345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.735130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.745074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1215/2440] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:08:11.749370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.760248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40708b-2947-4aa5-9f61-766379249380 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.766817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5b2cb-4243-4427-8258-08c8e472759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.767631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b2cb-4243-4427-8258-08c8e472759a admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.768084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b2cb-4243-4427-8258-08c8e472759a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.768363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5b2cb-4243-4427-8258-08c8e472759a admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.769149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5b2cb-4243-4427-8258-08c8e472759a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.770801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5b2cb-4243-4427-8258-08c8e472759a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.780929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1226/2441] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:11.785059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.796400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3d4b-4eb4-4485-ae07-0369a51dc991 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:11.802052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:11.803518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.803843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.804149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] PATH_INFO: `/v3/projects/8397aa06462b4e23a54ced14249001a7/users/4dd30ab37ba8488e86d0c1ce9036048f/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.821945 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8397aa06462b4e23a54ced14249001a7, user_id=4dd30ab37ba8488e86d0c1ce9036048f, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:11.824874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:11.839225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1216/2442] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:11 2022] PUT /identity/v3/projects/8397aa06462b4e23a54ced14249001a7/users/4dd30ab37ba8488e86d0c1ce9036048f/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:11.850119 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:11.850501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:11.850810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:11.876884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] MFA Rules not processed for user `4dd30ab37ba8488e86d0c1ce9036048f`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:11.878127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:11.942074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1227/2443] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:11.953549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:11.955351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:12.028018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6d8e6-811a-4c45-8a0c-8e4b36dc2665 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:12.033927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d17e7d-162f-4568-8533-32b371b717cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:12.034593 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d17e7d-162f-4568-8533-32b371b717cf service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:12.034967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d17e7d-162f-4568-8533-32b371b717cf service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:12.035319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d17e7d-162f-4568-8533-32b371b717cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:12.046909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d17e7d-162f-4568-8533-32b371b717cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:12.046909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d17e7d-162f-4568-8533-32b371b717cf service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:12.056307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1217/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:12.250360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:12.312254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5884c7-4954-4153-ac5d-7459044d27c9 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:12.316950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:12.317826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:12.318154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:12.319007 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] PATH_INFO: `/v3/users/4dd30ab37ba8488e86d0c1ce9036048f` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:12.320260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd30ab37ba8488e86d0c1ce9036048f)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:12.322199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:12.370282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd30ab37ba8488e86d0c1ce9036048f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:12.370987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd30ab37ba8488e86d0c1ce9036048f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:12.383930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd30ab37ba8488e86d0c1ce9036048f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:12.392770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd30ab37ba8488e86d0c1ce9036048f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:12.393521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd30ab37ba8488e86d0c1ce9036048f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:12.412438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1228/2445] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:12 2022] DELETE /identity/v3/users/4dd30ab37ba8488e86d0c1ce9036048f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:12.414005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:12.414478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:12.414712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:12.435643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:12.436874 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:12.518469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1218/2446] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:08:12.528623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:12.530084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:12.594416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b2aa-805f-4330-9b13-e595f44fbd4b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:12.598405 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce8e2-110b-44c5-b873-3709b7f03030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:12.599190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce8e2-110b-44c5-b873-3709b7f03030 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:12.600297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce8e2-110b-44c5-b873-3709b7f03030 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:12.600706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce8e2-110b-44c5-b873-3709b7f03030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:12.612179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce8e2-110b-44c5-b873-3709b7f03030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:12.613803 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce8e2-110b-44c5-b873-3709b7f03030 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:12.624802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1229/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:12.916632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:12.918109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:12.932265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709f399-99ec-455d-bfb6-a96757a0ec45 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:12.937279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:12.938172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:12.938448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:12.938719 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] PATH_INFO: `/v3/projects/8397aa06462b4e23a54ced14249001a7` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:12.939930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8397aa06462b4e23a54ced14249001a7)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:12.941833 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:12.992538 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8397aa06462b4e23a54ced14249001a7', 'request_id': 'req-96cd805a-5c05-4930-8506-7b55af2f3951'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:13.001230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8397aa06462b4e23a54ced14249001a7', 'request_id': 'req-96cd805a-5c05-4930-8506-7b55af2f3951'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:13.007217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8397aa06462b4e23a54ced14249001a7', 'request_id': 'req-96cd805a-5c05-4930-8506-7b55af2f3951'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:13.018125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] The token cache is being invalidate because project 8397aa06462b4e23a54ced14249001a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:13.018447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:13.019092 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96cd805a-5c05-4930-8506-7b55af2f3951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:13.020672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1219/2448] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:12 2022] DELETE /identity/v3/projects/8397aa06462b4e23a54ced14249001a7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:13.025588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.025877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.026148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.043312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:13.044556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:13.122120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1230/2449] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:13.129897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.130192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.130479 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.151046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:13.152333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:13.160986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1220/2450] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:13.165685 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.175988 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc9eeab-d8c1-4ac1-85cb-6657091bb8d8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.182359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.183036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.183490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.183807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.184547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:13.184856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.186490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.202603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1231/2451] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:13.204150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.232725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0931a-d8f7-4be6-adb1-13701b081f7d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.238181 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.238845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.239128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.239406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.240130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.242598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.274276 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1221/2452] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/projects => generated 405 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:13.278258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.288882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa086c80-6ff3-44fb-b4f2-7b099bd3c6f8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.363674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.364604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.364726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.364918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.365653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.367637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.390048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1232/2453] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:13.394386 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.409108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90675fe-518f-4d76-aa57-76a5d6270b48 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.415687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.416357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.416683 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.416927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.418030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.420330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.432688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1222/2454] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:13.436604 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.455614 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b61503-e28c-462f-bf97-d0c1f12cbaf4 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.461343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea566c4-64a9-42bb-b20f-1a0df8454134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.462022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea566c4-64a9-42bb-b20f-1a0df8454134 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.462310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea566c4-64a9-42bb-b20f-1a0df8454134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.462804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea566c4-64a9-42bb-b20f-1a0df8454134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.463723 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea566c4-64a9-42bb-b20f-1a0df8454134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.466681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea566c4-64a9-42bb-b20f-1a0df8454134 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.479639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1233/2455] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:13.483364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.497192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4296-7997-4e9e-89f7-baaaa2948eb3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.502720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.503654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.503970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.504238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] PATH_INFO: `/v3/projects/989affd544f2465783560b8f580fbf5b/users/72b18141eadd4280b1566c6c1f7d6fa3/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.520477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=989affd544f2465783560b8f580fbf5b, user_id=72b18141eadd4280b1566c6c1f7d6fa3, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.523856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.545758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1223/2456] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:13 2022] PUT /identity/v3/projects/989affd544f2465783560b8f580fbf5b/users/72b18141eadd4280b1566c6c1f7d6fa3/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:13.550087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.550506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.550892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.594691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] MFA Rules not processed for user `72b18141eadd4280b1566c6c1f7d6fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:13.596190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:13.662562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1234/2457] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:13.667044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.727737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50c22-4599-460b-8085-17a1ae8158ea admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.732463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.733059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.733352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.733638 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.734344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.736296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.766714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1224/2458] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:13.767592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.777996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdc15a-cf46-4ee2-982b-f0a95d7cc072 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.833164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.833841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.834181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.834466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.835239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.837168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.860518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1235/2459] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:13 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:08:13.861738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.874710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f4c89-f8b5-4eae-9ebd-7027a243c394 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.879626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.880430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.880710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.881017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.882248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.883895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.894647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1225/2460] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:08:13.899126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.909409 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505a8e5-54ce-4479-8443-8d88728f1237 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:13.914665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:13.915659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:13.915953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:13.916233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] PATH_INFO: `/v3/projects/cbbd65c5780046b8a34fdccba61b7bc5/users/813a379bb05a4147b6ab9bea92a09d38/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:13.932031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbd65c5780046b8a34fdccba61b7bc5, user_id=813a379bb05a4147b6ab9bea92a09d38, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:13.934775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:13.950255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1236/2461] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:13 2022] PUT /identity/v3/projects/cbbd65c5780046b8a34fdccba61b7bc5/users/813a379bb05a4147b6ab9bea92a09d38/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:13.959667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:13.969763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1a61-68f0-48e1-8535-836cf919d23a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:14.028653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78f677-b002-45f3-bd3b-c133a7889ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:14.029327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f677-b002-45f3-bd3b-c133a7889ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.029617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f677-b002-45f3-bd3b-c133a7889ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.029899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78f677-b002-45f3-bd3b-c133a7889ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.030632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f677-b002-45f3-bd3b-c133a7889ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:14.033096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78f677-b002-45f3-bd3b-c133a7889ce0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:14.042834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1226/2462] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:14.047392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:14.058381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b359ad8-6139-4e06-9872-919c44c83291 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:14.063009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:14.063918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.064197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.064466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] PATH_INFO: `/v3/projects/cbbd65c5780046b8a34fdccba61b7bc5/users/813a379bb05a4147b6ab9bea92a09d38/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.066526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbbd65c5780046b8a34fdccba61b7bc5, user_id=813a379bb05a4147b6ab9bea92a09d38, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:14.069843 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:14.080040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1237/2463] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:14 2022] PUT /identity/v3/projects/cbbd65c5780046b8a34fdccba61b7bc5/users/813a379bb05a4147b6ab9bea92a09d38/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:14.090083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.090443 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.090732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.117970 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] MFA Rules not processed for user `813a379bb05a4147b6ab9bea92a09d38`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:14.119213 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:14.187068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1227/2464] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:14.200473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:14.202503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:14.261606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b7111-4cca-4c20-9052-fd96c61fc000 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:14.265158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7efdc-d5ab-4449-9297-522b1fb47a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:14.265800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7efdc-d5ab-4449-9297-522b1fb47a71 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.266683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7efdc-d5ab-4449-9297-522b1fb47a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.266967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7efdc-d5ab-4449-9297-522b1fb47a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.276553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7efdc-d5ab-4449-9297-522b1fb47a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:14.277981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7efdc-d5ab-4449-9297-522b1fb47a71 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:14.287340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1238/2465] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:08:14.417501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:14.478358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbd249-2c6a-4042-b090-a347e0b4e3da None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:14.482877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:14.483763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.484046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.484317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] PATH_INFO: `/v3/users/72b18141eadd4280b1566c6c1f7d6fa3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.485490 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b18141eadd4280b1566c6c1f7d6fa3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:14.487422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:14.658434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b18141eadd4280b1566c6c1f7d6fa3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:14.665734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b18141eadd4280b1566c6c1f7d6fa3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:14.677050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b18141eadd4280b1566c6c1f7d6fa3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:14.677685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b18141eadd4280b1566c6c1f7d6fa3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:14.684749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b18141eadd4280b1566c6c1f7d6fa3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:14.690327 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1228/2466] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:14 2022] DELETE /identity/v3/users/72b18141eadd4280b1566c6c1f7d6fa3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:14.695272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.695595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.695886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.712879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:14.714169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:14.776674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1239/2467] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:14.786462 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:14.788392 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:14.842353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b258c-75ac-4885-8a5d-db66073f2ae8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:14.845971 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:14.846599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:14.846884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:14.847159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:14.856721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:14.858132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:14.868369 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1229/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:15.143796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:15.145386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:15.162083 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c11f7-4a60-4ebf-988d-72621ac3e729 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:15.168275 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:15.169345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.169634 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.169916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] PATH_INFO: `/v3/projects/989affd544f2465783560b8f580fbf5b` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:15.171155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989affd544f2465783560b8f580fbf5b)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:15.173402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:15.223877 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989affd544f2465783560b8f580fbf5b', 'request_id': 'req-778ad907-d668-426e-841a-5e04b7cce0e5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.230811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989affd544f2465783560b8f580fbf5b', 'request_id': 'req-778ad907-d668-426e-841a-5e04b7cce0e5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.236370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989affd544f2465783560b8f580fbf5b', 'request_id': 'req-778ad907-d668-426e-841a-5e04b7cce0e5'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.249667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] The token cache is being invalidate because project 989affd544f2465783560b8f580fbf5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:15.249778 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.250384 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.251964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1240/2469] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:15 2022] DELETE /identity/v3/projects/989affd544f2465783560b8f580fbf5b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:15.256009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:15.265853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94b34a-6c03-40c6-9ce8-5f95b456c4e6 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:15.319488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:15.320381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.320666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.320941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] PATH_INFO: `/v3/users/813a379bb05a4147b6ab9bea92a09d38` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:15.322111 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=813a379bb05a4147b6ab9bea92a09d38)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:15.324051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:15.368785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813a379bb05a4147b6ab9bea92a09d38'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.375207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813a379bb05a4147b6ab9bea92a09d38'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.387023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813a379bb05a4147b6ab9bea92a09d38'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.387699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813a379bb05a4147b6ab9bea92a09d38'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.394264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fdd45173-c0c1-4177-9792-1cc8c6edee4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813a379bb05a4147b6ab9bea92a09d38'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.401124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1230/2470] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:15 2022] DELETE /identity/v3/users/813a379bb05a4147b6ab9bea92a09d38 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:15.680570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:15.682047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:15.697017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad907-d668-426e-841a-5e04b7cce0e5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:15.752009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:15.752801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.753090 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.753370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] PATH_INFO: `/v3/projects/cbbd65c5780046b8a34fdccba61b7bc5` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:15.754643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbbd65c5780046b8a34fdccba61b7bc5)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:15.756690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:15.802351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbbd65c5780046b8a34fdccba61b7bc5', 'request_id': 'req-ceb39ad3-f610-461e-a026-005b6c7c1428'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.808554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbbd65c5780046b8a34fdccba61b7bc5', 'request_id': 'req-ceb39ad3-f610-461e-a026-005b6c7c1428'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.813847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbbd65c5780046b8a34fdccba61b7bc5', 'request_id': 'req-ceb39ad3-f610-461e-a026-005b6c7c1428'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.825162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] The token cache is being invalidate because project cbbd65c5780046b8a34fdccba61b7bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:15.825449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.826066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ceb39ad3-f610-461e-a026-005b6c7c1428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:15.827681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1241/2471] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:15 2022] DELETE /identity/v3/projects/cbbd65c5780046b8a34fdccba61b7bc5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:15.832501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a201c-411e-48d0-92fd-46e340815034 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.832992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a201c-411e-48d0-92fd-46e340815034 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.833099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a201c-411e-48d0-92fd-46e340815034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:15.851818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-561a201c-411e-48d0-92fd-46e340815034 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:15.852942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-561a201c-411e-48d0-92fd-46e340815034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:15.908747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1231/2472] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:15.918363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.918653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.918933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:15.936847 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:15.938038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:15.946118 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1242/2473] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:15.950081 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a201c-411e-48d0-92fd-46e340815034 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:15.960144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a201c-411e-48d0-92fd-46e340815034 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:15.964617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:15.965264 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.965547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.965824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:15.966548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:15.966859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:15.968482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:15.980882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1232/2474] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:15.985036 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:15.994033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4bc7-e75b-4772-aee1-2242ba6e731d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:15.998649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:15.999290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:15.999609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:15.999886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.000576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.002513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.027242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1243/2475] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:15 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:08:16.031398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.042792 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a7c88-b6a7-465a-b2c7-8d581c6001a6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.102407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.103130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.103420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.103732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.104433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.106343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.124694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1233/2476] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:16 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:16.128913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.139348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314c548-ac48-4eee-9a89-4f4f958cfa2a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.143925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.144571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.144859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.145135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.145851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.148043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.159214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1244/2477] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:16.163433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.175351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60d3f-1383-4325-b631-b8ce85d50c8b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.180093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa11b4-6608-463c-ae7b-5b602cd1dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.180729 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa11b4-6608-463c-ae7b-5b602cd1dd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.181015 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa11b4-6608-463c-ae7b-5b602cd1dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.181295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa11b4-6608-463c-ae7b-5b602cd1dd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.182046 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa11b4-6608-463c-ae7b-5b602cd1dd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.184098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa11b4-6608-463c-ae7b-5b602cd1dd98 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.196626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1234/2478] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:16.201648 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.212159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a213bc1-93ce-4b7f-9761-6f82f79c0f29 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.216592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.217465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.217746 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.218021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] PATH_INFO: `/v3/projects/1f79010e2328479a9ba6f5a5ac784aaf/users/d9b6761b04874aab9783f07d0efc42eb/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.232671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f79010e2328479a9ba6f5a5ac784aaf, user_id=d9b6761b04874aab9783f07d0efc42eb, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.235318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.248258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1245/2479] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:16 2022] PUT /identity/v3/projects/1f79010e2328479a9ba6f5a5ac784aaf/users/d9b6761b04874aab9783f07d0efc42eb/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:16.259830 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.260060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.260335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.290926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] MFA Rules not processed for user `d9b6761b04874aab9783f07d0efc42eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:16.292248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:16.374670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.376387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:16.380629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1235/2480] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:16.385606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.445647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b918d3f-2f71-4be0-b047-cfac59b0bb83 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.449678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.450334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.450621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.450901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.452411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac00f2-0bc9-4c73-87c4-f6c6cd0b8122 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.452755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:16.458433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.459433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.459580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.460301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.461005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.462906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.469157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.470638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.481114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1246/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:08:16.493619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1236/2482] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:16 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:16.497775 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.508945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6df85-a5b3-4a07-96c3-3a2e1a771e75 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.568056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.568647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.568957 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.569740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.570504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.572502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.597065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1247/2483] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:16 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:16.598717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.610181 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d864c-1777-4437-9475-4343856041a3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.616500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.617178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.617465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.617744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.619079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.620752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.633379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1237/2484] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:16.637953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.648192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130163dd-9e68-4477-82ce-14830aa589ee admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.652887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.657764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.658059 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.658347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] PATH_INFO: `/v3/projects/e29f843db7aa48608a0fdf3f1261fe9d/users/4b63d32d0d0b46f991a5abde2f2b75c3/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.673315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29f843db7aa48608a0fdf3f1261fe9d, user_id=4b63d32d0d0b46f991a5abde2f2b75c3, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.676319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.692851 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1248/2485] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:16 2022] PUT /identity/v3/projects/e29f843db7aa48608a0fdf3f1261fe9d/users/4b63d32d0d0b46f991a5abde2f2b75c3/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:16.697687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.709772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ef473-1628-4305-ac5a-64b4f76dc663 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.775149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7339d-c1e7-4c49-a8c6-4676bcae5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.775850 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7339d-c1e7-4c49-a8c6-4676bcae5712 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.776135 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7339d-c1e7-4c49-a8c6-4676bcae5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.776415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7339d-c1e7-4c49-a8c6-4676bcae5712 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.777196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7339d-c1e7-4c49-a8c6-4676bcae5712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.778793 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7339d-c1e7-4c49-a8c6-4676bcae5712 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.788599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1238/2486] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:08:16.793048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.806478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d678-568a-4edb-b153-5e345454b2c9 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:16.811381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:16.812553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.812840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.813143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] PATH_INFO: `/v3/projects/e29f843db7aa48608a0fdf3f1261fe9d/users/4b63d32d0d0b46f991a5abde2f2b75c3/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.815340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29f843db7aa48608a0fdf3f1261fe9d, user_id=4b63d32d0d0b46f991a5abde2f2b75c3, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:16.818203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:16.829392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1249/2487] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:16 2022] PUT /identity/v3/projects/e29f843db7aa48608a0fdf3f1261fe9d/users/4b63d32d0d0b46f991a5abde2f2b75c3/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:16.839506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:16.840037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:16.840306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:16.871858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] MFA Rules not processed for user `4b63d32d0d0b46f991a5abde2f2b75c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:16.873139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:16.947031 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1239/2488] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:16.959550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:16.961353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:17.024736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3601ea-07d9-4073-8a84-202b18af863b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:17.029653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:17.030403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:17.030686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:17.030963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:17.089476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:17.090824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:17.099486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1250/2489] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:19.961215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:19.962677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:20.030606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ce60d-163f-4122-a70f-a20a8fc93e7d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.035769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.036643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.036925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.037200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] PATH_INFO: `/v3/users/23a85c0f0bff4056af1d8f6691da236c` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.038992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a85c0f0bff4056af1d8f6691da236c)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.040950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.085353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a85c0f0bff4056af1d8f6691da236c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.092590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a85c0f0bff4056af1d8f6691da236c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.104391 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a85c0f0bff4056af1d8f6691da236c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.105030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a85c0f0bff4056af1d8f6691da236c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.111368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c66c48e8-f06c-4b32-8009-6985a12da7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a85c0f0bff4056af1d8f6691da236c'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.117726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1240/2490] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:19 2022] DELETE /identity/v3/users/23a85c0f0bff4056af1d8f6691da236c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:20.285902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.298541 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc7fd-fe85-4de7-a9be-f11f3a4fe7e7 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.361620 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.362504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.362780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.363051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] PATH_INFO: `/v3/projects/78017a13ef7b4d90a1ea6145bf2f5232` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.364242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78017a13ef7b4d90a1ea6145bf2f5232)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.366201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.411469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78017a13ef7b4d90a1ea6145bf2f5232', 'request_id': 'req-b4827286-7a75-45a4-87c0-e9105a375e8f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.417437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78017a13ef7b4d90a1ea6145bf2f5232', 'request_id': 'req-b4827286-7a75-45a4-87c0-e9105a375e8f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.422766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78017a13ef7b4d90a1ea6145bf2f5232', 'request_id': 'req-b4827286-7a75-45a4-87c0-e9105a375e8f'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.435508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] The token cache is being invalidate because project 78017a13ef7b4d90a1ea6145bf2f5232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:20.435824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.436461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b4827286-7a75-45a4-87c0-e9105a375e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:20.438023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1251/2491] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:20 2022] DELETE /identity/v3/projects/78017a13ef7b4d90a1ea6145bf2f5232 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:08:20.442715 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.443003 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.443281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.460994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:20.462279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:20.518168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1241/2492] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:20.525706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.525996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.526268 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.543824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:20.544996 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:20.552998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1252/2493] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:20.557472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.566713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268e94e-6111-454d-8730-fafe4121ef7f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.571954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.572598 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.572883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.573161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.573884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:20.574191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.575807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.586742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1242/2494] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:20.590883 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.600140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775767-b1b6-4c2f-82af-87937555b9ee None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.604836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.605485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.605772 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.606052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.606741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.608713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.634247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1253/2495] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:20 2022] POST /identity/v3/projects => generated 399 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:20.638075 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.647642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8a5e3-9a25-46c8-a38a-55c7119037e6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.700777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.701428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.701717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.701997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.702703 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.704659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.728160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1243/2496] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:20 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:20.730112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.740691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274b98e-4768-4f03-b248-6b58a67d0b62 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.746071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.746730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.747022 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.747303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.748129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.749682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.760577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1254/2497] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:20.764692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.774530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653c4a8-9e4b-4a53-89eb-f934b5a1c246 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.779006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa715c18-37c5-46d2-95e6-2a940df93cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.779685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715c18-37c5-46d2-95e6-2a940df93cef admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.779974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715c18-37c5-46d2-95e6-2a940df93cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.780252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa715c18-37c5-46d2-95e6-2a940df93cef admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.780969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa715c18-37c5-46d2-95e6-2a940df93cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.782557 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa715c18-37c5-46d2-95e6-2a940df93cef admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.792424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1244/2498] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:08:20.796395 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:20.807438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a2c566-5711-4c97-9cd4-00ac9394e65c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:20.812045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:20.812916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.813202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.813485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] PATH_INFO: `/v3/projects/032d30258d3c4d4e9312acee080bb60d/users/e9a4db1571904de784f8932137034781/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.827353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032d30258d3c4d4e9312acee080bb60d, user_id=e9a4db1571904de784f8932137034781, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:20.830028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:20.842072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1255/2499] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:20 2022] PUT /identity/v3/projects/032d30258d3c4d4e9312acee080bb60d/users/e9a4db1571904de784f8932137034781/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:20.852928 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:20.853226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:20.853510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:20.880372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] MFA Rules not processed for user `e9a4db1571904de784f8932137034781`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:20.881551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:20.945009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1245/2500] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:08:20.949443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.010023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5cd6a-e86e-4506-8fed-f1ccf719e8c6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.014715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.015375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.015693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.015973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.016678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.018597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.046590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1256/2501] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:20 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:21.050821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.061347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab39fc-2d5d-4b1f-9a5a-821439bfa6c6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.114834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.115500 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.115817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.116133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.117459 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.119390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.138543 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1246/2502] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:21 2022] POST /identity/v3/users => generated 307 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:21.142528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.152691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca76f-743b-46c5-8910-daffbbba4e1c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.157278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.157931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.158220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.158503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.159228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.160879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.171028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1257/2503] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:21.175000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.185136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eeca90-7879-4d3e-aa88-92e830d37430 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.189608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.190463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.190744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.191022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] PATH_INFO: `/v3/projects/bd64fe768abe45c78c3c7e4a118cd54f/users/7e9277f9d8ad4c9499cf57b548dfafca/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.205432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd64fe768abe45c78c3c7e4a118cd54f, user_id=7e9277f9d8ad4c9499cf57b548dfafca, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.208114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.220653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1247/2504] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:21 2022] PUT /identity/v3/projects/bd64fe768abe45c78c3c7e4a118cd54f/users/7e9277f9d8ad4c9499cf57b548dfafca/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:08:21.224465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.234070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ddb26-9bda-41b2-bbc6-6541f46606d8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.285936 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd479119-5d33-4092-8cfc-e7aa59cd17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.286583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479119-5d33-4092-8cfc-e7aa59cd17fe admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.286892 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479119-5d33-4092-8cfc-e7aa59cd17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.287165 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd479119-5d33-4092-8cfc-e7aa59cd17fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.287896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd479119-5d33-4092-8cfc-e7aa59cd17fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.289485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd479119-5d33-4092-8cfc-e7aa59cd17fe admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.298642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1258/2505] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:21.302893 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.313422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f52fd-2c6c-4320-8c15-93d3b95682b3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.317956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.318847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.319133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.319408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] PATH_INFO: `/v3/projects/bd64fe768abe45c78c3c7e4a118cd54f/users/7e9277f9d8ad4c9499cf57b548dfafca/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.322012 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd64fe768abe45c78c3c7e4a118cd54f, user_id=7e9277f9d8ad4c9499cf57b548dfafca, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.324644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.335095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1248/2506] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:21 2022] PUT /identity/v3/projects/bd64fe768abe45c78c3c7e4a118cd54f/users/7e9277f9d8ad4c9499cf57b548dfafca/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:21.345045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d177e3-c976-4495-9127-34477accac0d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.345334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d177e3-c976-4495-9127-34477accac0d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.345610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d177e3-c976-4495-9127-34477accac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.370909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-70d177e3-c976-4495-9127-34477accac0d None None] MFA Rules not processed for user `7e9277f9d8ad4c9499cf57b548dfafca`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:21.372197 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-70d177e3-c976-4495-9127-34477accac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:21.436970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1259/2507] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:21.448104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.449819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:21.510919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa67cd-99ff-419a-b3f6-5ff01be276a6 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.514546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.515189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.516090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.516090 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.525352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.526780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.536535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1249/2508] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:21.612807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d177e3-c976-4495-9127-34477accac0d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:21.624709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d177e3-c976-4495-9127-34477accac0d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:21.628349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:21.629013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:21.629298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:21.629576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:21.683015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:21.684469 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:21.692911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1260/2509] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:23.816217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:23.817716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:23.828400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c7a8-4db0-43f2-9e1d-bc24b8e2c38a service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:23.831910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:23.832527 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:23.832805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:23.833077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:23.834773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:23.893875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:23.895300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e168-9f65-474d-8e8c-588ee8728a79 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:23.904691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1250/2510] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:28.856191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:28.924610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d58d3-6196-45ad-a812-307e22eae94f service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:28.929381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:28.930460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:28.930684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:28.930964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] PATH_INFO: `/v3/users/e9a4db1571904de784f8932137034781` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:28.932168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a4db1571904de784f8932137034781)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:28.934078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:28.978650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a4db1571904de784f8932137034781'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:28.979307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a4db1571904de784f8932137034781'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:28.990579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a4db1571904de784f8932137034781'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:28.998078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a4db1571904de784f8932137034781'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:28.998704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a4db1571904de784f8932137034781'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.011700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1261/2511] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:28 2022] DELETE /identity/v3/users/e9a4db1571904de784f8932137034781 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:29.016690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:29.017231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:29.017342 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:29.034783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:29.036022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:29.097641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1251/2512] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:29.107301 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:29.108939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:29.165606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d83f-7e09-46cb-b552-c6b5f597a9c2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:29.169236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:29.169885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:29.170171 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:29.170448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:29.179825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:29.181396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:29.191277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1262/2513] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:29.476924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:29.479115 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:29.493039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2278c-af8d-4e65-8f80-ced241639492 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:29.502781 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:29.503741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:29.504011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:29.504282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] PATH_INFO: `/v3/projects/032d30258d3c4d4e9312acee080bb60d` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:29.505492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=032d30258d3c4d4e9312acee080bb60d)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:29.507380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:29.552752 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032d30258d3c4d4e9312acee080bb60d', 'request_id': 'req-5dd69d59-80ab-4032-afda-ce7477eec69d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.560398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032d30258d3c4d4e9312acee080bb60d', 'request_id': 'req-5dd69d59-80ab-4032-afda-ce7477eec69d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.565838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032d30258d3c4d4e9312acee080bb60d', 'request_id': 'req-5dd69d59-80ab-4032-afda-ce7477eec69d'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.576889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] The token cache is being invalidate because project 032d30258d3c4d4e9312acee080bb60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:29.577183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.577834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.579348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1252/2514] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:29 2022] DELETE /identity/v3/projects/032d30258d3c4d4e9312acee080bb60d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:29.583282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:29.593172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97752f8-46e8-4394-b73d-401724c13919 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:29.647912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:29.648804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:29.649686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:29.649971 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] PATH_INFO: `/v3/users/7e9277f9d8ad4c9499cf57b548dfafca` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:29.651315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9277f9d8ad4c9499cf57b548dfafca)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:29.653470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:29.698543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9277f9d8ad4c9499cf57b548dfafca'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.699191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9277f9d8ad4c9499cf57b548dfafca'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.710586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9277f9d8ad4c9499cf57b548dfafca'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.717050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9277f9d8ad4c9499cf57b548dfafca'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.717759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-56117c76-c52b-4c59-b332-78461a109f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9277f9d8ad4c9499cf57b548dfafca'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:29.729946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1263/2515] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:29 2022] DELETE /identity/v3/users/7e9277f9d8ad4c9499cf57b548dfafca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:30.008691 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.010993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:30.026388 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69d59-80ab-4032-afda-ce7477eec69d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.085643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.086508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.087312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.087624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] PATH_INFO: `/v3/projects/bd64fe768abe45c78c3c7e4a118cd54f` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.088903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd64fe768abe45c78c3c7e4a118cd54f)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.090804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.134721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd64fe768abe45c78c3c7e4a118cd54f', 'request_id': 'req-96dce91e-12b0-4a8f-9f0a-2d38562bac88'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:30.141815 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd64fe768abe45c78c3c7e4a118cd54f', 'request_id': 'req-96dce91e-12b0-4a8f-9f0a-2d38562bac88'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:30.147101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd64fe768abe45c78c3c7e4a118cd54f', 'request_id': 'req-96dce91e-12b0-4a8f-9f0a-2d38562bac88'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:30.158037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] The token cache is being invalidate because project bd64fe768abe45c78c3c7e4a118cd54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:30.158330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:30.158967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-96dce91e-12b0-4a8f-9f0a-2d38562bac88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:30.160592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1253/2516] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:30 2022] DELETE /identity/v3/projects/bd64fe768abe45c78c3c7e4a118cd54f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:30.166018 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.166471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.166578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.184133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:30.185310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:30.241713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1264/2517] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:30.250725 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.251035 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.251316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.275308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:30.276551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:30.287513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1254/2518] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:30.292451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.302167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbf312-a8c8-4936-a694-c1de09434b69 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.306697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.307338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.307653 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.307932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.308645 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:30.308950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.310537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.321637 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1265/2519] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:30.325813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.335676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318ed0-a304-4e3e-8479-a3b26c409a86 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.340706 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.341344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.341625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.341897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.342914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.344841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.370393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1255/2520] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:30.374696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.384782 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b4275-31fa-4723-891b-d470fd8922fd admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.437247 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.437830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.438112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.438381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.439062 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.440995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.459820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1266/2521] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:30.464366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.474609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d78fc-9e29-45f0-8a2b-ead797bbfbad admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.479175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.479867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.480159 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.480441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.481173 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.482757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.492658 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1256/2522] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:30.496357 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.506076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48307e8b-3eda-4022-8410-32a30f1c13f9 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.511150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09440a-3b14-4208-bce2-27228b58dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.511828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09440a-3b14-4208-bce2-27228b58dc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.512112 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09440a-3b14-4208-bce2-27228b58dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.512389 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09440a-3b14-4208-bce2-27228b58dc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.513108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09440a-3b14-4208-bce2-27228b58dc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.514693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09440a-3b14-4208-bce2-27228b58dc5d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.531583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1267/2523] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:30.532728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.542997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1b7b-17a7-4b40-bbd6-c2b303945452 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.547890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.548772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.549060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.549339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] PATH_INFO: `/v3/projects/b388563560c34970962bc1c3d530b6e8/users/c56e51a1a08643e29621d67bd6da30d5/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.568885 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b388563560c34970962bc1c3d530b6e8, user_id=c56e51a1a08643e29621d67bd6da30d5, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.572154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.585930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1257/2524] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:30 2022] PUT /identity/v3/projects/b388563560c34970962bc1c3d530b6e8/users/c56e51a1a08643e29621d67bd6da30d5/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:30.596701 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.597201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.597561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.625385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] MFA Rules not processed for user `c56e51a1a08643e29621d67bd6da30d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:30.626703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:30.690365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1268/2525] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:30.694977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.761431 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9dc7-70eb-4bfa-aab7-d7eb459b988b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.767396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.767993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.768282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.768562 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.769376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.771642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.800370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1258/2526] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:30.804870 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.816179 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd061d6-1143-495f-8048-6aec9cdecdcd None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.870615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.871323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.871674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.871952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.872656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.874568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.893567 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1269/2527] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:30 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:08:30.897642 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.908136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b64b80-5917-4592-bcff-6035ca73a320 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.912716 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.913365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.913655 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.913938 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.914659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.916890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.927198 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1259/2528] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:30.931318 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.941011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca038b-bfee-48eb-90bd-6892cccab7b4 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:30.945451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:30.946315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:30.946597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:30.946874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] PATH_INFO: `/v3/projects/874f32c008424d2680e1c923a42053ca/users/58f6670117914611b042e509598afae1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:30.960876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874f32c008424d2680e1c923a42053ca, user_id=58f6670117914611b042e509598afae1, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:30.964072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:30.976558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1270/2529] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:30 2022] PUT /identity/v3/projects/874f32c008424d2680e1c923a42053ca/users/58f6670117914611b042e509598afae1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:30.981063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:30.990804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586652-0ce2-47a0-839f-57a7a2102d03 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:31.044190 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b8a5-b51c-4a25-b86f-1720d058e418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:31.044840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b8a5-b51c-4a25-b86f-1720d058e418 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.045131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b8a5-b51c-4a25-b86f-1720d058e418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.045414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b8a5-b51c-4a25-b86f-1720d058e418 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.046137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b8a5-b51c-4a25-b86f-1720d058e418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:31.047758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b8a5-b51c-4a25-b86f-1720d058e418 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:31.057429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1260/2530] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:31.061691 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:31.071781 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5f337-3cd7-4b37-9e21-e4a667fcb221 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:31.076385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:31.077259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.077547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.077828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] PATH_INFO: `/v3/projects/874f32c008424d2680e1c923a42053ca/users/58f6670117914611b042e509598afae1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.079806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874f32c008424d2680e1c923a42053ca, user_id=58f6670117914611b042e509598afae1, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:31.082460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:31.092931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1271/2531] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:31 2022] PUT /identity/v3/projects/874f32c008424d2680e1c923a42053ca/users/58f6670117914611b042e509598afae1/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:31.103362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.103692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.103974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.130033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] MFA Rules not processed for user `58f6670117914611b042e509598afae1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:31.131222 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:31.195019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1261/2532] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:31.206419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:31.208202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:31.262639 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7bc1-2c24-4c77-8463-edf3281f3b76 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:31.266310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186f8f6-7fe2-433f-95d0-5eb4a4888cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:31.266938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f8f6-7fe2-433f-95d0-5eb4a4888cba service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.267227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f8f6-7fe2-433f-95d0-5eb4a4888cba service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.267506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186f8f6-7fe2-433f-95d0-5eb4a4888cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.276967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f8f6-7fe2-433f-95d0-5eb4a4888cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:31.278400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186f8f6-7fe2-433f-95d0-5eb4a4888cba service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:31.287624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1272/2533] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:31.630687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:31.689351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c0045-1cf3-426a-abca-285cf02e2362 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:31.693819 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:31.694673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.694958 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.695236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] PATH_INFO: `/v3/users/c56e51a1a08643e29621d67bd6da30d5` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.697027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56e51a1a08643e29621d67bd6da30d5)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:31.698984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:31.740324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56e51a1a08643e29621d67bd6da30d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:31.747997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56e51a1a08643e29621d67bd6da30d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:31.760089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56e51a1a08643e29621d67bd6da30d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:31.760816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56e51a1a08643e29621d67bd6da30d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:31.767589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56e51a1a08643e29621d67bd6da30d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:31.773576 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1262/2534] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:31 2022] DELETE /identity/v3/users/c56e51a1a08643e29621d67bd6da30d5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:31.778081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.778377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.778714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.797251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:31.798451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:31.856093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1273/2535] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:31.866429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:31.867878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:31.929562 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00f4b3-5cbf-492e-8967-478a03b1371c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:31.933853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:31.934486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:31.934770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:31.935042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:31.943757 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:31.945169 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:31.954296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1263/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:32.207602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:32.209028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:32.220596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2f052-6241-4ac5-a098-bd980dcd13b3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:32.225143 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:32.226073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:32.226353 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:32.226664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] PATH_INFO: `/v3/projects/b388563560c34970962bc1c3d530b6e8` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:32.228526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b388563560c34970962bc1c3d530b6e8)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:32.230560 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:32.275764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b388563560c34970962bc1c3d530b6e8', 'request_id': 'req-6c85d108-b2ca-489a-a152-9cf40d7c10fc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.281564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b388563560c34970962bc1c3d530b6e8', 'request_id': 'req-6c85d108-b2ca-489a-a152-9cf40d7c10fc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.286724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b388563560c34970962bc1c3d530b6e8', 'request_id': 'req-6c85d108-b2ca-489a-a152-9cf40d7c10fc'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.298579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] The token cache is being invalidate because project b388563560c34970962bc1c3d530b6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:32.298864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.299477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.301020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1274/2537] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:32 2022] DELETE /identity/v3/projects/b388563560c34970962bc1c3d530b6e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:32.305329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:32.314738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838f60d-d0cd-450a-8631-ac6464856185 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:32.369366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:32.370236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:32.370521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:32.370795 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] PATH_INFO: `/v3/users/58f6670117914611b042e509598afae1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:32.371998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f6670117914611b042e509598afae1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:32.373914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:32.417133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f6670117914611b042e509598afae1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.423969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f6670117914611b042e509598afae1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.435652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f6670117914611b042e509598afae1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.436284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f6670117914611b042e509598afae1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.442883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-cc0a3a43-48cd-43ef-91aa-6cba638ab8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f6670117914611b042e509598afae1'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.448615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1264/2538] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:32 2022] DELETE /identity/v3/users/58f6670117914611b042e509598afae1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:32.711848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:32.713291 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:32.726293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85d108-b2ca-489a-a152-9cf40d7c10fc admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:32.782610 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:32.783509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:32.783820 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:32.784094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] PATH_INFO: `/v3/projects/874f32c008424d2680e1c923a42053ca` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:32.785267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=874f32c008424d2680e1c923a42053ca)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:32.787231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:32.832380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874f32c008424d2680e1c923a42053ca', 'request_id': 'req-8929be64-4615-4c63-ac0f-f5c750b3c1c7'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.838366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874f32c008424d2680e1c923a42053ca', 'request_id': 'req-8929be64-4615-4c63-ac0f-f5c750b3c1c7'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.843494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874f32c008424d2680e1c923a42053ca', 'request_id': 'req-8929be64-4615-4c63-ac0f-f5c750b3c1c7'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.855492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] The token cache is being invalidate because project 874f32c008424d2680e1c923a42053ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:32.855805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.856433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8929be64-4615-4c63-ac0f-f5c750b3c1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:32.858161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1275/2539] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:32 2022] DELETE /identity/v3/projects/874f32c008424d2680e1c923a42053ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:32.862711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:32.863000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:32.863275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:32.880753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:32.881925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:32.937493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1265/2540] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:32.946195 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:32.946547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:32.946835 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:32.964878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:32.966069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:32.974194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1276/2541] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:32.978665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:32.987920 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd04a7-7f66-4914-8901-79ee19f845d2 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:32.992304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:32.992939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:32.993219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:32.994030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:32.994743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:32.995047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:32.996651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.007515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1266/2542] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:33.012032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:33.021379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0f9b-18fe-4ef9-80e9-7cd1230044e5 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:33.026694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:33.027344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.027684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.027965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.028651 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:33.030683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.055777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1277/2543] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:33 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:33.060226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:33.070014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515bf6f-8085-4978-8e0f-154e32bd20d3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:33.124395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:33.125056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.125413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.125804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.126495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:33.128444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.146743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1267/2544] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:33 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:33.151317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:33.161871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04351e-98ae-413f-b444-ddc7051fa218 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:33.168507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:33.168507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.168507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.168905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.169703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:33.171287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.181906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1278/2545] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:33.186052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:33.195842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97eff5-533d-4af2-b4b2-43bc12cd3563 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:33.200463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaafd3-2401-4159-923c-e2943eb76f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:33.201112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaafd3-2401-4159-923c-e2943eb76f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.201398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaafd3-2401-4159-923c-e2943eb76f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.201675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaafd3-2401-4159-923c-e2943eb76f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.202398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaafd3-2401-4159-923c-e2943eb76f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:33.204040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaafd3-2401-4159-923c-e2943eb76f6e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.214016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1268/2546] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:33.217970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:33.227600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1fc3a-c749-4965-9d70-55e3b0381aae admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:33.232677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:33.233534 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.233811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.234084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] PATH_INFO: `/v3/projects/2c3a3745ef124f83ad64828a1017b6d1/users/47a6a36a15ff48ecaeb6592f972a668e/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.247915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3a3745ef124f83ad64828a1017b6d1, user_id=47a6a36a15ff48ecaeb6592f972a668e, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:33.250570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.263095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1279/2547] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:33 2022] PUT /identity/v3/projects/2c3a3745ef124f83ad64828a1017b6d1/users/47a6a36a15ff48ecaeb6592f972a668e/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:33.272927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.273249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.273528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.300149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] MFA Rules not processed for user `47a6a36a15ff48ecaeb6592f972a668e`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:33.301352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:33.362401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1269/2548] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:33.373587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:33.375227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:33.431710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53c601-7331-4ed0-b058-3fba07aaa7b7 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:33.435572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633ef1-5d82-4ece-bfd4-cc49f69d1457 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:33.436285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633ef1-5d82-4ece-bfd4-cc49f69d1457 service glance] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:33.436570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633ef1-5d82-4ece-bfd4-cc49f69d1457 service glance] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:33.436848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633ef1-5d82-4ece-bfd4-cc49f69d1457 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:33.445213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633ef1-5d82-4ece-bfd4-cc49f69d1457 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:33.447152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633ef1-5d82-4ece-bfd4-cc49f69d1457 service glance] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:33.456187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1280/2549] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:08:55.759673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:55.761133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:55.822677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3744569-bef0-4d64-ac1f-02db442c96a3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:55.827734 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:55.828595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:55.828909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:55.829185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] PATH_INFO: `/v3/users/d9b6761b04874aab9783f07d0efc42eb` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:55.830368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b6761b04874aab9783f07d0efc42eb)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:55.832325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:55.877331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b6761b04874aab9783f07d0efc42eb'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:55.883827 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b6761b04874aab9783f07d0efc42eb'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:55.895419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b6761b04874aab9783f07d0efc42eb'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:55.896072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b6761b04874aab9783f07d0efc42eb'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:55.902502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b6761b04874aab9783f07d0efc42eb'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:55.908157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1270/2550] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:55 2022] DELETE /identity/v3/users/d9b6761b04874aab9783f07d0efc42eb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:55.912810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:55.913276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:55.913373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:55.930388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:55.931868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:55.987532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1281/2551] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:55.997168 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:55.998555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:56.052735 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd14923-87bf-47a5-afe8-dd91d84b1bf7 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:56.056603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:56.057244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:56.057530 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:56.057810 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:56.066832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:56.068287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:56.079312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1271/2552] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:56.336237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:56.337678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:56.351225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bcf6d-694e-44e3-8cdd-abfac4b83c08 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:56.356040 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:56.356920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:56.357342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:56.357505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] PATH_INFO: `/v3/projects/1f79010e2328479a9ba6f5a5ac784aaf` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:56.358712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f79010e2328479a9ba6f5a5ac784aaf)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:56.360949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:56.405234 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f79010e2328479a9ba6f5a5ac784aaf', 'request_id': 'req-c2812c60-9808-4ce2-8bb4-fef3187096ce'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.415767 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f79010e2328479a9ba6f5a5ac784aaf', 'request_id': 'req-c2812c60-9808-4ce2-8bb4-fef3187096ce'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.422277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f79010e2328479a9ba6f5a5ac784aaf', 'request_id': 'req-c2812c60-9808-4ce2-8bb4-fef3187096ce'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.433924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] The token cache is being invalidate because project 1f79010e2328479a9ba6f5a5ac784aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:56.434213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.435334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.436925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1282/2553] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:56 2022] DELETE /identity/v3/projects/1f79010e2328479a9ba6f5a5ac784aaf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:56.441182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:56.452249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240f309-501b-4d2d-9b3e-7f5bd2515e60 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:56.505841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:56.506698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:56.506974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:56.507242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] PATH_INFO: `/v3/users/4b63d32d0d0b46f991a5abde2f2b75c3` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:56.508436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b63d32d0d0b46f991a5abde2f2b75c3)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:56.510375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:56.553633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b63d32d0d0b46f991a5abde2f2b75c3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.561368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b63d32d0d0b46f991a5abde2f2b75c3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.573128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b63d32d0d0b46f991a5abde2f2b75c3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.573802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b63d32d0d0b46f991a5abde2f2b75c3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.581068 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2bd35ebb-9da7-4ba7-9379-c90eb492da0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b63d32d0d0b46f991a5abde2f2b75c3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.586654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1272/2554] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:56 2022] DELETE /identity/v3/users/4b63d32d0d0b46f991a5abde2f2b75c3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:56.850981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:56.852448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:56.865659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2812c60-9808-4ce2-8bb4-fef3187096ce admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:56.921912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:56.922810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:56.923093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:56.923367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] PATH_INFO: `/v3/projects/e29f843db7aa48608a0fdf3f1261fe9d` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:56.924590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29f843db7aa48608a0fdf3f1261fe9d)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:56.926613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:56.971499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29f843db7aa48608a0fdf3f1261fe9d', 'request_id': 'req-33442760-88e3-4b33-832b-6657574602f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.977351 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29f843db7aa48608a0fdf3f1261fe9d', 'request_id': 'req-33442760-88e3-4b33-832b-6657574602f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.983015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29f843db7aa48608a0fdf3f1261fe9d', 'request_id': 'req-33442760-88e3-4b33-832b-6657574602f6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.995280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] The token cache is being invalidate because project e29f843db7aa48608a0fdf3f1261fe9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:56.995590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.996208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-33442760-88e3-4b33-832b-6657574602f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:56.998342 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1283/2555] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:56 2022] DELETE /identity/v3/projects/e29f843db7aa48608a0fdf3f1261fe9d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:08:57.003210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.003717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.003849 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.021186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:57.022312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:57.080528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1273/2556] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:57.088276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.088565 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.088845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.106225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:57.107471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:57.115126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1284/2557] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:57.119061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.129071 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ddb1-9271-4007-9190-a3bd8e3d7cc6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.133665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.134321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.134609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.134884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.135747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:57.136054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.138202 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.149427 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1274/2558] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:08:57.153514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.162537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235782-24d9-4cd5-8d91-c98082f2b940 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.167224 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.167931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.168221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.168501 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.169187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.171102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.195836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1285/2559] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:57.199751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.209877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d8614-d1f0-42a2-b796-d0ab973e574a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.262326 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.263550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.263840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.264117 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.264805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.266714 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.284950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1275/2560] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:57.288998 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.298945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644077a9-20f9-470c-914a-d4b57a532c6f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.303492 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.304175 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.304462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.304741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.305467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.307320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.318905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1286/2561] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:57.322633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.333033 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155fc54-4417-4179-84c1-63a1bf5269a4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.337536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330786a-d11f-44ab-8920-8d9e679c268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.338180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330786a-d11f-44ab-8920-8d9e679c268b admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.338469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330786a-d11f-44ab-8920-8d9e679c268b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.338750 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330786a-d11f-44ab-8920-8d9e679c268b admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.339473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330786a-d11f-44ab-8920-8d9e679c268b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.341080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330786a-d11f-44ab-8920-8d9e679c268b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.350558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1276/2562] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:57.354611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.364248 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066958a-4146-428d-b6bd-4b5479527b43 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.368740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.369624 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.369907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.370182 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] PATH_INFO: `/v3/projects/83ac068c34ed495389a1bd23d6eb52d9/users/086e99eb692d4b7db06d4030addeeba6/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.384362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ac068c34ed495389a1bd23d6eb52d9, user_id=086e99eb692d4b7db06d4030addeeba6, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.386993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.400563 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1287/2563] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:57 2022] PUT /identity/v3/projects/83ac068c34ed495389a1bd23d6eb52d9/users/086e99eb692d4b7db06d4030addeeba6/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:57.410617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.410912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.411220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.437749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] MFA Rules not processed for user `086e99eb692d4b7db06d4030addeeba6`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:57.438968 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:57.498654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1277/2564] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:57.503177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.561766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4057fdd-6412-4021-93b3-3cd6ecceecfd admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.566307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.566968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.567259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.567577 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.568290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.570287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.599345 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1288/2565] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:57.600743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.611312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a536fa4-0c36-4075-83f3-91e4a36ec6e8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.665823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.666489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.666769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.667043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.667755 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.669739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.689531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1278/2566] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:57.693730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.704630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a481e7-0659-4d61-8554-474031af2dfc admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.710309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.710968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.711252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.711546 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.712280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.713894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.725836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1289/2567] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:08:57.730025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.739765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f73903-548b-489b-b7e6-d78bc50876aa admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.744366 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.745263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.745521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.745797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] PATH_INFO: `/v3/projects/45dc8355324244ba91d2a1a81a126442/users/a5b0fb81b1c74a0f9024c2b6c914986a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.763329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dc8355324244ba91d2a1a81a126442, user_id=a5b0fb81b1c74a0f9024c2b6c914986a, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.766235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.780413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1279/2568] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:57 2022] PUT /identity/v3/projects/45dc8355324244ba91d2a1a81a126442/users/a5b0fb81b1c74a0f9024c2b6c914986a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:57.784343 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.794167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05770e-29f3-48b5-aab7-9e38b08a64e8 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.848443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf34d-ed3b-42b2-8caa-6345794ead48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.849023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf34d-ed3b-42b2-8caa-6345794ead48 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.849362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf34d-ed3b-42b2-8caa-6345794ead48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.849631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf34d-ed3b-42b2-8caa-6345794ead48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.850479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf34d-ed3b-42b2-8caa-6345794ead48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.852201 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf34d-ed3b-42b2-8caa-6345794ead48 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.863147 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1290/2569] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:57.866743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:57.876790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614bf23-79d8-44b5-8ac6-2d931f5199d4 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:57.881413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:57.882319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.882603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.882878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] PATH_INFO: `/v3/projects/45dc8355324244ba91d2a1a81a126442/users/a5b0fb81b1c74a0f9024c2b6c914986a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.884878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dc8355324244ba91d2a1a81a126442, user_id=a5b0fb81b1c74a0f9024c2b6c914986a, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:57.887471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:57.897934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1280/2570] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:57 2022] PUT /identity/v3/projects/45dc8355324244ba91d2a1a81a126442/users/a5b0fb81b1c74a0f9024c2b6c914986a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:08:57.909398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:57.909708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:57.909978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:57.938021 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] MFA Rules not processed for user `a5b0fb81b1c74a0f9024c2b6c914986a`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:57.939228 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:58.010220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1291/2571] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:58.021492 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:58.023221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:58.080564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c927-0b0e-40eb-86c8-42d8a71dab42 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:58.084283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb407f9a-c284-4f80-abf0-b64f447c3ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:58.084929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb407f9a-c284-4f80-abf0-b64f447c3ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:58.085247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb407f9a-c284-4f80-abf0-b64f447c3ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:58.085528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb407f9a-c284-4f80-abf0-b64f447c3ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:58.095272 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb407f9a-c284-4f80-abf0-b64f447c3ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:58.096749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb407f9a-c284-4f80-abf0-b64f447c3ca5 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:58.106364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1281/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:58.133046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:58.193901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7399ed7-2044-42e4-8b42-b17b3ab135c8 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:58.198493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:58.199386 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:58.199696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:58.199994 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] PATH_INFO: `/v3/users/086e99eb692d4b7db06d4030addeeba6` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:58.201739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086e99eb692d4b7db06d4030addeeba6)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:58.203829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:58.246399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086e99eb692d4b7db06d4030addeeba6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.247085 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086e99eb692d4b7db06d4030addeeba6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.258336 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086e99eb692d4b7db06d4030addeeba6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.265744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086e99eb692d4b7db06d4030addeeba6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.266375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086e99eb692d4b7db06d4030addeeba6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.277934 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1292/2573] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:58 2022] DELETE /identity/v3/users/086e99eb692d4b7db06d4030addeeba6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:58.282925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:58.283308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:58.283684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:58.301116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:58.302294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:58.358835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1282/2574] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:58.368221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:58.369649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:58.429259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab30c4-899a-4e1b-8e64-310060686fa5 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:58.433153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:58.433795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:58.434080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:58.434356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:58.443107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:58.444561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:58.454271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1293/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:08:58.708193 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:58.709594 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:58.723039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb087042-7fde-4e7b-9d2c-fbb0969e539f None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:58.728205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:58.729069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:58.729352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:58.729625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] PATH_INFO: `/v3/projects/83ac068c34ed495389a1bd23d6eb52d9` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:58.731050 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ac068c34ed495389a1bd23d6eb52d9)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:58.733590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:58.782355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ac068c34ed495389a1bd23d6eb52d9', 'request_id': 'req-5d4b4121-3669-4db7-a790-16947b05a997'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.789470 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ac068c34ed495389a1bd23d6eb52d9', 'request_id': 'req-5d4b4121-3669-4db7-a790-16947b05a997'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.795393 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ac068c34ed495389a1bd23d6eb52d9', 'request_id': 'req-5d4b4121-3669-4db7-a790-16947b05a997'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.805842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] The token cache is being invalidate because project 83ac068c34ed495389a1bd23d6eb52d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:58.806383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.807002 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:58.808541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1283/2576] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:58 2022] DELETE /identity/v3/projects/83ac068c34ed495389a1bd23d6eb52d9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:58.812549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:58.822039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842be41-3adc-4ed0-966c-c36a2e1d9be0 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:58.876955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:58.877814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:58.878088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:58.878356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] PATH_INFO: `/v3/users/a5b0fb81b1c74a0f9024c2b6c914986a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:58.879507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b0fb81b1c74a0f9024c2b6c914986a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:58.881440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.056640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b0fb81b1c74a0f9024c2b6c914986a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.057344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b0fb81b1c74a0f9024c2b6c914986a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.068923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b0fb81b1c74a0f9024c2b6c914986a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.077098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b0fb81b1c74a0f9024c2b6c914986a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.077780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-7a6e0298-d11f-4b9c-a0a3-0efc6d628c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b0fb81b1c74a0f9024c2b6c914986a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.090019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1294/2577] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:08:58 2022] DELETE /identity/v3/users/a5b0fb81b1c74a0f9024c2b6c914986a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:59.348870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.350299 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:59.364520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b4121-3669-4db7-a790-16947b05a997 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.420059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.420914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.421200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.421480 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] PATH_INFO: `/v3/projects/45dc8355324244ba91d2a1a81a126442` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.422650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45dc8355324244ba91d2a1a81a126442)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.424618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.468994 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dc8355324244ba91d2a1a81a126442', 'request_id': 'req-608e3a8b-c0a3-48f3-8077-4a20565f01d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.475817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dc8355324244ba91d2a1a81a126442', 'request_id': 'req-608e3a8b-c0a3-48f3-8077-4a20565f01d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.481203 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dc8355324244ba91d2a1a81a126442', 'request_id': 'req-608e3a8b-c0a3-48f3-8077-4a20565f01d5'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.491591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] The token cache is being invalidate because project 45dc8355324244ba91d2a1a81a126442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:08:59.491882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.492507 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-608e3a8b-c0a3-48f3-8077-4a20565f01d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:08:59.493995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1284/2578] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:08:59 2022] DELETE /identity/v3/projects/45dc8355324244ba91d2a1a81a126442 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:59.499338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.499673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.499955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.517677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:59.518868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:59.573981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1295/2579] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:59.582363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.582672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.582950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.600640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:59.601826 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:08:59.610552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1285/2580] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:08:59.614629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.624507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d88784-da89-4446-9316-a62a0444fd23 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.629013 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.629700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.629984 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.630260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.630976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:08:59.631282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.632920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.644669 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1296/2581] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 16:08:59.648764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.657721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013730ec-ecc0-490a-a0fa-899c63928ec3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.662419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.663053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.663337 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.663650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.664325 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.666196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.691669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1286/2582] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:08:59 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:08:59.695596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.706796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7985e8-04d6-42c3-9b1d-29b3044fe1cb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.760931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.761597 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.761881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.762159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.762863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.765414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.785968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1297/2583] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:08:59 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:08:59.790008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.801783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff07630-f54d-49d4-94c4-68512984b2bc admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.808152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.808816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.809132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.809411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.810913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.812834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.823175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1287/2584] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:59.827352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.837070 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3feffd-cef3-45ff-8e88-527fc876c5c1 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.844115 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe8849-1c75-41ca-b8b4-2b363cb6d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.844855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8849-1c75-41ca-b8b4-2b363cb6d4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.845151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8849-1c75-41ca-b8b4-2b363cb6d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.845439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe8849-1c75-41ca-b8b4-2b363cb6d4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.846183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe8849-1c75-41ca-b8b4-2b363cb6d4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.847821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe8849-1c75-41ca-b8b4-2b363cb6d4d2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.857963 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1298/2585] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:08:59.862163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:08:59.871974 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea73924-ee74-48c2-9621-65abe26c1854 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:08:59.877112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:08:59.878000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.878283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.878567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] PATH_INFO: `/v3/projects/6da003c29e434eaa8a5c3a9575bde3a8/users/c0563a183c994c46867ee8c6c4240411/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.893082 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da003c29e434eaa8a5c3a9575bde3a8, user_id=c0563a183c994c46867ee8c6c4240411, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:08:59.895721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:08:59.908929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1288/2586] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:08:59 2022] PUT /identity/v3/projects/6da003c29e434eaa8a5c3a9575bde3a8/users/c0563a183c994c46867ee8c6c4240411/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:08:59.918873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:08:59.919158 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:08:59.919434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:08:59.944754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] MFA Rules not processed for user `c0563a183c994c46867ee8c6c4240411`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:08:59.945955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:00.007020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1299/2587] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:00.014802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.076455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3743a-8b09-4a86-b236-5039cba40909 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.081069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.081726 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.082013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.082292 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.082977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.084882 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.108540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1289/2588] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:00 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:00.112747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.123521 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bf39f-e324-4b4c-a848-6dd02c24598d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.182060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.182763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.183050 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.183327 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.184076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.186510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.205846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1300/2589] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:00 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:00.209978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.219931 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e18cc-e0b3-47c3-8865-79cde8b72aa0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.224419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.225064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.225351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.225630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.226348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.227967 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.238219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1290/2590] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:00.242245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.252811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0be76-51d5-4a12-a9a1-d1f68ab9bb37 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.257382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.258238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.258520 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.258792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] PATH_INFO: `/v3/projects/cbacdbaebdd1498c9d3fbd3d7c932c10/users/8a737d9918d84d20b4b99869c88acd34/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.273451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbacdbaebdd1498c9d3fbd3d7c932c10, user_id=8a737d9918d84d20b4b99869c88acd34, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.276079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.288375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1301/2591] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:00 2022] PUT /identity/v3/projects/cbacdbaebdd1498c9d3fbd3d7c932c10/users/8a737d9918d84d20b4b99869c88acd34/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:00.292335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.301959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28136d7-46ec-4aaa-a2da-e9c503250a09 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.356552 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4979f0-978c-4744-925d-33302cc1c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.357216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4979f0-978c-4744-925d-33302cc1c217 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.357505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4979f0-978c-4744-925d-33302cc1c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.357784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4979f0-978c-4744-925d-33302cc1c217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.358511 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4979f0-978c-4744-925d-33302cc1c217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.360194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4979f0-978c-4744-925d-33302cc1c217 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.369615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1291/2592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:00.374287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.384290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd2136-d93d-4f8f-9c61-d36781e7867f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.389416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.390288 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.390572 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.390874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] PATH_INFO: `/v3/projects/cbacdbaebdd1498c9d3fbd3d7c932c10/users/8a737d9918d84d20b4b99869c88acd34/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.392832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbacdbaebdd1498c9d3fbd3d7c932c10, user_id=8a737d9918d84d20b4b99869c88acd34, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.395444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.405277 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1302/2593] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:00 2022] PUT /identity/v3/projects/cbacdbaebdd1498c9d3fbd3d7c932c10/users/8a737d9918d84d20b4b99869c88acd34/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:00.416329 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.416652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.416932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.443544 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] MFA Rules not processed for user `8a737d9918d84d20b4b99869c88acd34`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:00.444773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:00.509821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1292/2594] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:00.522039 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.523810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:00.578154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703122c-d943-43a7-91e6-28885f4239cc admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.581822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.582476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.582737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.583016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.591694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.593113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.602105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1303/2595] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:00.884399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.894061 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75626b0d-31b3-454b-a00e-19bd98d9855d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.898731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a737d9918d84d20b4b99869c88acd34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.899381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.899717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.899998 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.900751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:00.901091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.902702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.913972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1293/2596] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:09:00.918051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.927153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455a783-46c2-47f5-bacd-4443dcb47484 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:00.932600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a737d9918d84d20b4b99869c88acd34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:00.933242 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:00.933532 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:00.933839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:00.934527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:00.937082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:00.962535 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1304/2597] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:00 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:00.967132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:00.976848 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd8669-3cbf-40d4-ad5a-34b0a5a0aa4e tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:01.030881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a737d9918d84d20b4b99869c88acd34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:01.031553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:01.031847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:01.032132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:01.032846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:01.033157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:01.034743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:01.045467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1294/2598] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:09:01.080802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:01.090712 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71242d9a-aa81-41ec-a60b-c6b6f673b771 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:01.095942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a737d9918d84d20b4b99869c88acd34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:01.096795 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:01.097137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:01.097363 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] PATH_INFO: `/v3/projects/dcbdbcbf6f2a4f8ab1a80a56883f5559` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:01.098539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dcbdbcbf6f2a4f8ab1a80a56883f5559)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:01.100480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:01.147011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbdbcbf6f2a4f8ab1a80a56883f5559', 'request_id': 'req-f8b7554a-b745-4d37-b577-6c2980ec15f3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.155005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbdbcbf6f2a4f8ab1a80a56883f5559', 'request_id': 'req-f8b7554a-b745-4d37-b577-6c2980ec15f3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.160413 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbdbcbf6f2a4f8ab1a80a56883f5559', 'request_id': 'req-f8b7554a-b745-4d37-b577-6c2980ec15f3'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.172649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] The token cache is being invalidate because project dcbdbcbf6f2a4f8ab1a80a56883f5559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:01.172990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.173674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-f8b7554a-b745-4d37-b577-6c2980ec15f3 tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.175244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1305/2599] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:01 2022] DELETE /identity/v3/projects/dcbdbcbf6f2a4f8ab1a80a56883f5559 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:01.365347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:01.367246 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:01.434182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f327c-b4ec-4993-b991-1c08483d0cdf tempest-VolumeQuotaClassesTest-2138939883 tempest-VolumeQuotaClassesTest-2138939883-project-admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:01.488186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:01.489104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:01.489394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:01.489665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] PATH_INFO: `/v3/users/c0563a183c994c46867ee8c6c4240411` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:01.497439 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0563a183c994c46867ee8c6c4240411)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:01.500274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:01.546525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0563a183c994c46867ee8c6c4240411'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.553424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0563a183c994c46867ee8c6c4240411'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.566689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0563a183c994c46867ee8c6c4240411'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.567475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0563a183c994c46867ee8c6c4240411'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.574680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0563a183c994c46867ee8c6c4240411'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:01.580523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1295/2600] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:01 2022] DELETE /identity/v3/users/c0563a183c994c46867ee8c6c4240411 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:01.584985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:01.585261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:01.585543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:01.603677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:01.604811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:01.660788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1306/2601] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:01.670873 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:01.672274 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:01.727395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0660-4b73-4174-b9ca-af68878c0987 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:01.731029 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:01.731701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:01.732582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:01.732866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:01.741641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:01.743057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:01.752495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1296/2602] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:02.008801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:02.010273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:02.024581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604e7a3-9aac-4c69-82ca-2d366f97d902 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:02.029716 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:02.030659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.030940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.031213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] PATH_INFO: `/v3/projects/6da003c29e434eaa8a5c3a9575bde3a8` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.032903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da003c29e434eaa8a5c3a9575bde3a8)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:02.034990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:02.080189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da003c29e434eaa8a5c3a9575bde3a8', 'request_id': 'req-90bdfc8a-84f2-48aa-afda-154968e01e5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.085988 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da003c29e434eaa8a5c3a9575bde3a8', 'request_id': 'req-90bdfc8a-84f2-48aa-afda-154968e01e5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.091072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da003c29e434eaa8a5c3a9575bde3a8', 'request_id': 'req-90bdfc8a-84f2-48aa-afda-154968e01e5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.102762 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] The token cache is being invalidate because project 6da003c29e434eaa8a5c3a9575bde3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:02.103047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.103687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.105188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1307/2603] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:02 2022] DELETE /identity/v3/projects/6da003c29e434eaa8a5c3a9575bde3a8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:02.109662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:02.119032 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181033e-06e5-403b-951c-eb93192e4a5c service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:02.172419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:02.173195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.173474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.173744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] PATH_INFO: `/v3/users/8a737d9918d84d20b4b99869c88acd34` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.174913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a737d9918d84d20b4b99869c88acd34)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:02.176845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:02.221039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a737d9918d84d20b4b99869c88acd34'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.227764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a737d9918d84d20b4b99869c88acd34'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.239286 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a737d9918d84d20b4b99869c88acd34'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.239921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a737d9918d84d20b4b99869c88acd34'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.246374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-4b708e24-ae58-4f77-8142-058da7eb564f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a737d9918d84d20b4b99869c88acd34'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.252671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1297/2604] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:02 2022] DELETE /identity/v3/users/8a737d9918d84d20b4b99869c88acd34 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:02.470428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:02.471990 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:02.485339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdfc8a-84f2-48aa-afda-154968e01e5d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:02.545523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:02.546415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.546700 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.546980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] PATH_INFO: `/v3/users/47a6a36a15ff48ecaeb6592f972a668e` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.548235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a6a36a15ff48ecaeb6592f972a668e)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:02.550185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:02.598810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a6a36a15ff48ecaeb6592f972a668e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.599511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a6a36a15ff48ecaeb6592f972a668e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.612174 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a6a36a15ff48ecaeb6592f972a668e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.619821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a6a36a15ff48ecaeb6592f972a668e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.620505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a6a36a15ff48ecaeb6592f972a668e'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.632891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1308/2605] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:02 2022] DELETE /identity/v3/users/47a6a36a15ff48ecaeb6592f972a668e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:02.637379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.637894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.637995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.656419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:02.657777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:02.718176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1298/2606] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:02.727839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:02.729325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:02.753560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:02.755261 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:02.769161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134ab4c-a5b4-4e4c-9b25-2bbf5049c353 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:02.774613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:02.775640 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.775995 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.776280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] PATH_INFO: `/v3/projects/cbacdbaebdd1498c9d3fbd3d7c932c10` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.780453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbacdbaebdd1498c9d3fbd3d7c932c10)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:02.782381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:02.799390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076d3ac-8bb7-40ea-ba9e-966aa3c384f0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:02.803954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8180bcc-1763-465c-8507-ea6cc485aeb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:02.804609 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8180bcc-1763-465c-8507-ea6cc485aeb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.804894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8180bcc-1763-465c-8507-ea6cc485aeb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.806479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8180bcc-1763-465c-8507-ea6cc485aeb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.816344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8180bcc-1763-465c-8507-ea6cc485aeb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:02.818068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8180bcc-1763-465c-8507-ea6cc485aeb8 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:02.828574 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1309/2607] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:02.842946 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'request_id': 'req-8489e6d8-21e2-431b-8641-35914f14875a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.850018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'request_id': 'req-8489e6d8-21e2-431b-8641-35914f14875a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.855508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbacdbaebdd1498c9d3fbd3d7c932c10', 'request_id': 'req-8489e6d8-21e2-431b-8641-35914f14875a'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.866408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] The token cache is being invalidate because project cbacdbaebdd1498c9d3fbd3d7c932c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:02.866717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.867415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8489e6d8-21e2-431b-8641-35914f14875a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:02.869216 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1299/2608] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:02 2022] DELETE /identity/v3/projects/cbacdbaebdd1498c9d3fbd3d7c932c10 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:02.873968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.874337 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.874623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.897031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:02.898378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:02.958214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1310/2609] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:02.965901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:02.966195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:02.967049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:02.987837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:02.989140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.000665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1300/2610] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:03.002128 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.013093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5269-071a-4fc9-952e-27d0c0cb98aa None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.019512 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.020269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.020513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.020920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.021607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:03.021840 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.023704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.038849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1311/2611] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:09:03.043334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.052689 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c38047-026e-4d4c-88eb-9a00743905e4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.057891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.058558 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.058900 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.059263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.060017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.062493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.093184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1301/2612] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:03.097753 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.109582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.110526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d4f1-0496-4f7c-b19b-e4662a47f017 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.111339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.177500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.178167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.178376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb02b5-43c5-4215-b9c3-c23ab76d753b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.178509 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.178711 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.179402 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.181354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.183413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.184300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.184603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.184871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] PATH_INFO: `/v3/projects/2c3a3745ef124f83ad64828a1017b6d1` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.186582 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3a3745ef124f83ad64828a1017b6d1)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.188510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.202564 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1312/2613] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:03.206547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.216108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54d9d4-1577-4227-b91a-0ca1114aeacb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.221355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.221973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.222260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.222539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.223253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.224884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.234672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1313/2614] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:03.237929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3a3745ef124f83ad64828a1017b6d1', 'request_id': 'req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.238629 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.245323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3a3745ef124f83ad64828a1017b6d1', 'request_id': 'req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.248797 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b591c55-8e19-4997-8bd9-aec3111d932a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.251853 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3a3745ef124f83ad64828a1017b6d1', 'request_id': 'req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.262888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] The token cache is being invalidate because project 2c3a3745ef124f83ad64828a1017b6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:03.263311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.264630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5ee49ec8-adbc-4f43-b8cb-664bb65655cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.266297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1302/2615] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:03 2022] DELETE /identity/v3/projects/2c3a3745ef124f83ad64828a1017b6d1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:09:03.270957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da3cc0-e55f-4361-a907-1c68b4ae3b8a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.271249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da3cc0-e55f-4361-a907-1c68b4ae3b8a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.271590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da3cc0-e55f-4361-a907-1c68b4ae3b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.290226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-80da3cc0-e55f-4361-a907-1c68b4ae3b8a None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:03.291451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-80da3cc0-e55f-4361-a907-1c68b4ae3b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.302360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.303023 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.303309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.303619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.304338 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.305937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.316282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1314/2616] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:03.320308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.321931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.334194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dfc4-32eb-4caa-bfff-3d3c876abcc0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.338780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da35fc-ff43-42f8-9e94-8484ba60b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.339683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da35fc-ff43-42f8-9e94-8484ba60b794 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.339974 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da35fc-ff43-42f8-9e94-8484ba60b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.340253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da35fc-ff43-42f8-9e94-8484ba60b794 admin admin] PATH_INFO: `/v3/projects/8a9604e0cd8740778d651da859280aa5/users/9a014aa0dc1d412883419136cd814b62/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.349138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1303/2617] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:03.354156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da35fc-ff43-42f8-9e94-8484ba60b794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9604e0cd8740778d651da859280aa5, user_id=9a014aa0dc1d412883419136cd814b62, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.356845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da35fc-ff43-42f8-9e94-8484ba60b794 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.358104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.358421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.358742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.370503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1315/2618] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:03 2022] PUT /identity/v3/projects/8a9604e0cd8740778d651da859280aa5/users/9a014aa0dc1d412883419136cd814b62/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:09:03.378291 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:03.379508 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.382540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511340-4616-4366-a478-5457c322867e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.382922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511340-4616-4366-a478-5457c322867e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.383260 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511340-4616-4366-a478-5457c322867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.410895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-26511340-4616-4366-a478-5457c322867e None None] MFA Rules not processed for user `9a014aa0dc1d412883419136cd814b62`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:03.412133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-26511340-4616-4366-a478-5457c322867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.437311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1304/2619] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:03.441194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.450973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc2e37-e5ab-43cd-a78a-ea6978d8edd8 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.455758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.456414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.456818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.457144 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.458017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:03.458403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.460343 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.476857 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1305/2620] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 16:09:03.477758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.478434 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1316/2621] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:03.489189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d6ba9-8ead-4970-9390-d3b64b580f05 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.490141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511340-4616-4366-a478-5457c322867e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.491787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-26511340-4616-4366-a478-5457c322867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.494101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.494838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.495289 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.495705 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.496389 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.498916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.524630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1306/2622] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:03.528643 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.548491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511340-4616-4366-a478-5457c322867e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.591449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d411a-a013-47a1-9dc7-354f713e9977 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.596353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.597123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.597486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.597836 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.598520 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.599461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.600135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.600415 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.600553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.600690 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.620065 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1307/2623] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:03.624559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.633879 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f16-3fcb-482f-a95a-530c5c16416f admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.639269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.639950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.640268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.640553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.641270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.642842 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.652964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1308/2624] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:03.656615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.657323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.658066 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.666665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae37ed-4d1c-4299-9b0c-4bd3a058c878 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.666881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1317/2625] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:09:03.671283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.671954 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.672241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.672523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.673234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.674805 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.684852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1309/2626] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:03.685114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.688851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.695213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45fcc3-389d-4d49-9bad-d0f97f0f0418 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.698152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e80bb-a7a1-4b4e-afee-7601a3278732 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.699825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.700667 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.701506 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.701777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] PATH_INFO: `/v3/users/9a014aa0dc1d412883419136cd814b62` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.702938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a014aa0dc1d412883419136cd814b62)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.703303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa968ca-154b-4cda-86f2-bfb186b0f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.704182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa968ca-154b-4cda-86f2-bfb186b0f38f admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.704469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa968ca-154b-4cda-86f2-bfb186b0f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.704743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa968ca-154b-4cda-86f2-bfb186b0f38f admin admin] PATH_INFO: `/v3/projects/985a23f94d08400e897b842be0ec363f/users/a1826fe7b2b8458183dba3463e74e4ed/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.704868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.719878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa968ca-154b-4cda-86f2-bfb186b0f38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=985a23f94d08400e897b842be0ec363f, user_id=a1826fe7b2b8458183dba3463e74e4ed, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.722807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa968ca-154b-4cda-86f2-bfb186b0f38f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.737501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1310/2627] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:03 2022] PUT /identity/v3/projects/985a23f94d08400e897b842be0ec363f/users/a1826fe7b2b8458183dba3463e74e4ed/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:09:03.747451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.747852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.748455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.751466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a014aa0dc1d412883419136cd814b62'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.752221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a014aa0dc1d412883419136cd814b62'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.766073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a014aa0dc1d412883419136cd814b62'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.774404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a014aa0dc1d412883419136cd814b62'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.775053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c2f67e9d-3fac-4c91-9468-783dcffb9501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a014aa0dc1d412883419136cd814b62'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:03.776556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] MFA Rules not processed for user `a1826fe7b2b8458183dba3463e74e4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:03.777754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.787731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1318/2628] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:03 2022] DELETE /identity/v3/users/9a014aa0dc1d412883419136cd814b62 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:03.792222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.792543 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.792824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.809207 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:03.810907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.840055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1311/2629] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:03.868659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1319/2630] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:03.870237 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.871818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.878538 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:03.879982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:03.927441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5d9a2-db81-40f7-abd0-0d1b558baf9c None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.933756 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f8e-5f52-4602-a4f3-960e51fe0df1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:03.938166 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.938815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.939100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.939385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:03.948556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:03.949988 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:03.959825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1320/2631] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:09:03.974225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1339b3-2d8d-4679-b9d5-91ebf6bf6ee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:03.974886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1339b3-2d8d-4679-b9d5-91ebf6bf6ee1 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:03.975172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1339b3-2d8d-4679-b9d5-91ebf6bf6ee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:03.975503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1339b3-2d8d-4679-b9d5-91ebf6bf6ee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.031608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1339b3-2d8d-4679-b9d5-91ebf6bf6ee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.032987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1339b3-2d8d-4679-b9d5-91ebf6bf6ee1 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.042008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1312/2632] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:03 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:04.057114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.058548 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.072558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829e983-96de-4d7d-aa40-5102e228af01 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.078626 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.079649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.080009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.080364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] PATH_INFO: `/v3/users/a1826fe7b2b8458183dba3463e74e4ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.081579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1826fe7b2b8458183dba3463e74e4ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.083553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.135743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1826fe7b2b8458183dba3463e74e4ed'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.136414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1826fe7b2b8458183dba3463e74e4ed'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.148722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1826fe7b2b8458183dba3463e74e4ed'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.157507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1826fe7b2b8458183dba3463e74e4ed'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.158259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1826fe7b2b8458183dba3463e74e4ed'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.171045 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1321/2633] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:04 2022] DELETE /identity/v3/users/a1826fe7b2b8458183dba3463e74e4ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:04.175838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.176136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.176421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.193949 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:04.195217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.237442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.239758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.258364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1313/2634] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:04.268864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.270288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.312473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9057-ade4-45cc-8494-0bb041afbf17 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.317072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.317927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.318214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.318485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] PATH_INFO: `/v3/projects/8a9604e0cd8740778d651da859280aa5` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.319695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9604e0cd8740778d651da859280aa5)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.321608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.325157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afd652-c4e9-453c-b6c4-a0827f7d4c9d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.328820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959b839-bd85-44e8-8a79-b0bd94524ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.329464 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b839-bd85-44e8-8a79-b0bd94524ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.329742 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b839-bd85-44e8-8a79-b0bd94524ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.330016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959b839-bd85-44e8-8a79-b0bd94524ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.339176 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959b839-bd85-44e8-8a79-b0bd94524ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.340653 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959b839-bd85-44e8-8a79-b0bd94524ab0 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.350597 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1314/2635] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:09:04.367930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9604e0cd8740778d651da859280aa5', 'request_id': 'req-c64738f7-7e79-406f-85b6-d1614aff6226'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.374644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9604e0cd8740778d651da859280aa5', 'request_id': 'req-c64738f7-7e79-406f-85b6-d1614aff6226'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.380226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9604e0cd8740778d651da859280aa5', 'request_id': 'req-c64738f7-7e79-406f-85b6-d1614aff6226'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.392732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] The token cache is being invalidate because project 8a9604e0cd8740778d651da859280aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:04.393024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.393668 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c64738f7-7e79-406f-85b6-d1614aff6226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.395215 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1322/2636] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:04 2022] DELETE /identity/v3/projects/8a9604e0cd8740778d651da859280aa5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:04.400493 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.400864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.401151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.420298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:04.421670 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.486504 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1315/2637] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:04.494341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.494844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.494944 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.516127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:04.521057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.534256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1323/2638] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:04.538688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.548932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b8880-2739-489b-ae86-bbaa58bb3a81 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.553728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.554383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.554667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.554942 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.555699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:04.556011 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.557871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.569282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1316/2639] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:09:04.573680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.582743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b055aa-b1f4-443a-9a48-4588ddec6340 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.587321 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.588002 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.588290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.588575 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.589272 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.591169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.618285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1324/2640] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:04.622645 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.629252 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.631594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.638371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674ff30-b310-425e-9746-c3af7fc06c22 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.695626 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.696300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.696567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.696840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.697519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.699065 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ae916-f95c-4412-8087-6d065a644071 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.699412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.703703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.704556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.704828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.705104 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] PATH_INFO: `/v3/projects/985a23f94d08400e897b842be0ec363f` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.706302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985a23f94d08400e897b842be0ec363f)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.708251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.718960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1317/2641] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:04.722965 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.733089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003ae53-20ee-4b81-9a20-19e52a575997 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.738100 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.738897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.739189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.739467 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.740219 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.741797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.751661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1318/2642] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:04.754982 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985a23f94d08400e897b842be0ec363f', 'request_id': 'req-9049608c-05e0-4219-890b-92b0421d7bd0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.756515 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.761539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985a23f94d08400e897b842be0ec363f', 'request_id': 'req-9049608c-05e0-4219-890b-92b0421d7bd0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.766584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50f368-07ce-40c3-b184-9d421d248b0a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.769423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985a23f94d08400e897b842be0ec363f', 'request_id': 'req-9049608c-05e0-4219-890b-92b0421d7bd0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.782966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] The token cache is being invalidate because project 985a23f94d08400e897b842be0ec363f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:04.783480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.784581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-9049608c-05e0-4219-890b-92b0421d7bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:04.786309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1325/2643] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:04 2022] DELETE /identity/v3/projects/985a23f94d08400e897b842be0ec363f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:04.791352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556144fb-bf02-4850-8eb2-825786794c37 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.791680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556144fb-bf02-4850-8eb2-825786794c37 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.792024 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556144fb-bf02-4850-8eb2-825786794c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.812344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-556144fb-bf02-4850-8eb2-825786794c37 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:04.813531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-556144fb-bf02-4850-8eb2-825786794c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.830069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.830690 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.830982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.831268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.832039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.833677 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.844108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1319/2644] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:04.848295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.850043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.862665 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a167b-1eb2-4786-8c45-58832b9f7811 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.867226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc2db7-9fd6-4a8f-b0c3-e73704947ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.868231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2db7-9fd6-4a8f-b0c3-e73704947ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.868512 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2db7-9fd6-4a8f-b0c3-e73704947ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.868814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc2db7-9fd6-4a8f-b0c3-e73704947ab2 admin admin] PATH_INFO: `/v3/projects/a9d09203ab054561af7ff9236da15cee/users/8bee76e455064368964ed022fffdf052/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.879009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1326/2645] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:04.880732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.881026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.881305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.883085 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2db7-9fd6-4a8f-b0c3-e73704947ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d09203ab054561af7ff9236da15cee, user_id=8bee76e455064368964ed022fffdf052, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.885927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc2db7-9fd6-4a8f-b0c3-e73704947ab2 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.899887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1320/2646] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:04 2022] PUT /identity/v3/projects/a9d09203ab054561af7ff9236da15cee/users/8bee76e455064368964ed022fffdf052/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:09:04.900073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:04.901108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.910559 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.910855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.911134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.936601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] MFA Rules not processed for user `8bee76e455064368964ed022fffdf052`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:04.937794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:04.958809 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1327/2647] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:04.962903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:04.971977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8d94b-5b3c-4a61-8827-ee2731ba46f0 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:04.976537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:04.977173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:04.977458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:04.977731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:04.978445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:04.978749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:04.980361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:04.991906 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1328/2648] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 29 16:09:04.995962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.004321 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1321/2649] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:05.004993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f99c50-3041-4e3f-8151-a1fd54d3cf09 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.010666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.011438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.011886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.012186 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.012937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.015490 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.019403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.020907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:05.041889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1329/2650] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:04 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:05.046545 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.080814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf696-d2d1-484b-9146-285e5833161e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.105806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24680859-f498-4e62-bbf3-589e8e68e68e admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.111238 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.111941 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.112229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.112510 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.113198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.115125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.128230 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14409e7-6f8b-4494-8cb4-2cdfd91e43c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b029906da704309ad9b8da03b51c054', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.128939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14409e7-6f8b-4494-8cb4-2cdfd91e43c8 service glance] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.129226 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14409e7-6f8b-4494-8cb4-2cdfd91e43c8 service glance] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.129554 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14409e7-6f8b-4494-8cb4-2cdfd91e43c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.135608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1330/2651] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:05.140335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.150999 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd618e2-bd15-4844-9263-cf16a23d9509 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.155893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.156551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.156834 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.157130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.158015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.159638 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.169502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1331/2652] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:05.173882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.183884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd875a0-b813-427f-9387-f0e45a69a028 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.189103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.189727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.190168 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.190445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.191764 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.193137 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14409e7-6f8b-4494-8cb4-2cdfd91e43c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.193328 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.194563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14409e7-6f8b-4494-8cb4-2cdfd91e43c8 service glance] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.202724 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1332/2653] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:05.203312 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1322/2654] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:09:05.206587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.215601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff38d-1c66-4232-a62b-436b10d09933 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.220067 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.220911 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.221192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.221464 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] PATH_INFO: `/v3/projects/70ba46e874e64b43a30c024c9f4b06a2/users/f71e2e52e3354b7cb8103557676d4a80/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.238784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ba46e874e64b43a30c024c9f4b06a2, user_id=f71e2e52e3354b7cb8103557676d4a80, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.241603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.255232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1333/2655] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:05 2022] PUT /identity/v3/projects/70ba46e874e64b43a30c024c9f4b06a2/users/f71e2e52e3354b7cb8103557676d4a80/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:05.266191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.266485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.266762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.293442 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] MFA Rules not processed for user `f71e2e52e3354b7cb8103557676d4a80`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:05.294612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:05.359328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1323/2656] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:05.363959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.424939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c57d19-02d7-46ca-b649-c1114d9232ad admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.429555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.430213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.430496 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.430773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.431470 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.433650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.459041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1334/2657] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:05.463383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.474524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f0c7f-dfe0-425e-a64e-cbbc358ebb21 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.532005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.532803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.533105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.533495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.534179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.536197 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.556049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1324/2658] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:05.561006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.576032 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cc3e-4986-4130-8b0e-ca4a5e5733d1 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.581388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.582378 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.582556 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.582945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.583815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.585804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.596930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1335/2659] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:09:05.601127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.611778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e69c44-c4a1-422c-af8b-9a871ccbd69e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.618866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f613cd3-dcd9-49e3-adf4-9a23ef66db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.620297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613cd3-dcd9-49e3-adf4-9a23ef66db11 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.620851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613cd3-dcd9-49e3-adf4-9a23ef66db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.621524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f613cd3-dcd9-49e3-adf4-9a23ef66db11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.622260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f613cd3-dcd9-49e3-adf4-9a23ef66db11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.624412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f613cd3-dcd9-49e3-adf4-9a23ef66db11 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.635587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1325/2660] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:05.640841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.650846 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004051-2e7a-401e-b1a2-46ad35f955cd admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.655747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.656588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.656864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.657136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] PATH_INFO: `/v3/projects/5788a6ab29d04782acf6a9b28470dbe8/users/373383825b3f4990b515d5305b840005/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.672172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5788a6ab29d04782acf6a9b28470dbe8, user_id=373383825b3f4990b515d5305b840005, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.674786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.687802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1336/2661] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:05 2022] PUT /identity/v3/projects/5788a6ab29d04782acf6a9b28470dbe8/users/373383825b3f4990b515d5305b840005/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:05.697673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.698156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.698252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.723553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] MFA Rules not processed for user `373383825b3f4990b515d5305b840005`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:05.724735 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:05.797472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1326/2662] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:05.800005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.861305 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe5c98-8f79-4ce8-ae93-9d82ffb7d5c2 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.866120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.866776 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.867056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.867330 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.868048 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.869956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.898676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1337/2663] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:05.899780 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:05.911119 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd0595-f513-46e1-8672-e2b6381b32d3 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:05.969420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:05.970097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:05.970381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:05.970656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:05.971437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:05.973802 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:05.998001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1327/2664] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:05 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:06.000006 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:06.010732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92bc7e-6874-4761-8061-89cfdc27058f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:06.015480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:06.016312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:06.016630 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:06.016913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:06.017663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:06.019256 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:06.030265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1338/2665] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:06.034539 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:06.044868 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edac6a8-a59b-4dbf-bffe-a42fe6fc134b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:06.049546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:06.050433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:06.050717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:06.050996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] PATH_INFO: `/v3/projects/d5b6e04d62474b8c85ac6741e0d14435/users/9e8b8cac94384a93a608247a921a2b42/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:06.065955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b6e04d62474b8c85ac6741e0d14435, user_id=9e8b8cac94384a93a608247a921a2b42, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:06.068730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:06.083685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1328/2666] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:06 2022] PUT /identity/v3/projects/d5b6e04d62474b8c85ac6741e0d14435/users/9e8b8cac94384a93a608247a921a2b42/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:09:06.087616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:06.097212 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab93c7e-cd32-4fc9-9d62-c48baf72263a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:06.151991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbaf8d-c5e1-4843-b4f0-97c990b31bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:06.152598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbaf8d-c5e1-4843-b4f0-97c990b31bac admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:06.152879 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbaf8d-c5e1-4843-b4f0-97c990b31bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:06.153150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbaf8d-c5e1-4843-b4f0-97c990b31bac admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:06.153890 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbaf8d-c5e1-4843-b4f0-97c990b31bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:06.157081 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbaf8d-c5e1-4843-b4f0-97c990b31bac admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:06.168845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1339/2667] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:06.173816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:06.184632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7d246-5966-44f5-af94-e87b7bbd510e admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:06.189414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:06.190319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:06.190631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:06.190880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] PATH_INFO: `/v3/projects/d5b6e04d62474b8c85ac6741e0d14435/users/9e8b8cac94384a93a608247a921a2b42/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:06.192941 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b6e04d62474b8c85ac6741e0d14435, user_id=9e8b8cac94384a93a608247a921a2b42, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:06.195627 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:06.206254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1329/2668] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:06 2022] PUT /identity/v3/projects/d5b6e04d62474b8c85ac6741e0d14435/users/9e8b8cac94384a93a608247a921a2b42/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:06.216399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:06.216687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:06.217485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:06.244545 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] MFA Rules not processed for user `9e8b8cac94384a93a608247a921a2b42`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:06.245751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:06.312274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1340/2669] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:06.324432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:06.326140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:06.381163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2265a-eaf7-400d-9127-e1328f6a6659 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:06.384756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:06.385398 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:06.385680 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:06.385957 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:06.445086 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:06.446560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:06.456654 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1330/2670] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:07.941880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:07.952677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f750a6-4749-4c4f-a5ac-de4ab3423c6b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:07.956349 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:07.957017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:07.957297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:07.957570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:08.016953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:08.018392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:08.027141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1341/2671] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:08.515058 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:08.523632 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71deaa-26a1-4703-946f-576c1a3db087 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:08.527192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbacbe-97d5-4051-b209-27431fca362d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:08.527860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbacbe-97d5-4051-b209-27431fca362d service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:08.528147 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbacbe-97d5-4051-b209-27431fca362d service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:08.528425 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbacbe-97d5-4051-b209-27431fca362d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:08.537762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbacbe-97d5-4051-b209-27431fca362d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:08.539185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbacbe-97d5-4051-b209-27431fca362d service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:08.549739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1331/2672] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:12.376682 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:12.437177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42548b2b-7d6d-415c-8cc7-d238a83f2e65 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:12.441991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:12.442955 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:12.443237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:12.443513 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] PATH_INFO: `/v3/users/f71e2e52e3354b7cb8103557676d4a80` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:12.444815 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71e2e52e3354b7cb8103557676d4a80)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:12.446771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:12.490649 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71e2e52e3354b7cb8103557676d4a80'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:12.491329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71e2e52e3354b7cb8103557676d4a80'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:12.503362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71e2e52e3354b7cb8103557676d4a80'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:12.510390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71e2e52e3354b7cb8103557676d4a80'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:12.511003 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71e2e52e3354b7cb8103557676d4a80'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:12.522537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1342/2673] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:12 2022] DELETE /identity/v3/users/f71e2e52e3354b7cb8103557676d4a80 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:12.527030 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:12.527495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:12.527639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:12.546624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:12.547878 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:12.605807 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1332/2674] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:12.615808 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:12.617180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:12.672845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836238-5eab-47f5-8dc9-de4843110c14 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:12.676600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:12.677279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:12.677562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:12.677833 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:12.688655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:12.690279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:12.700192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1343/2675] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:12.961817 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:12.963218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:12.977062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c829271-8370-4582-9436-a10d44abb8bc None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:12.982956 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:12.984060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:12.984408 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:12.984747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] PATH_INFO: `/v3/projects/70ba46e874e64b43a30c024c9f4b06a2` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:12.985985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ba46e874e64b43a30c024c9f4b06a2)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:12.988007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:13.037619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ba46e874e64b43a30c024c9f4b06a2', 'request_id': 'req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.044396 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ba46e874e64b43a30c024c9f4b06a2', 'request_id': 'req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.050591 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ba46e874e64b43a30c024c9f4b06a2', 'request_id': 'req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.062918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] The token cache is being invalidate because project 70ba46e874e64b43a30c024c9f4b06a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:13.063217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.063898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.065440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1333/2676] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:12 2022] DELETE /identity/v3/projects/70ba46e874e64b43a30c024c9f4b06a2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:13.069480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:13.080253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5590552-b262-4dbb-ac32-e0c86dc5691f service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:13.136703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:13.137497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:13.137784 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:13.138063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] PATH_INFO: `/v3/users/373383825b3f4990b515d5305b840005` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:13.139253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373383825b3f4990b515d5305b840005)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:13.141792 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:13.187975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373383825b3f4990b515d5305b840005'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.188663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373383825b3f4990b515d5305b840005'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.200122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373383825b3f4990b515d5305b840005'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.209844 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373383825b3f4990b515d5305b840005'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.210473 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373383825b3f4990b515d5305b840005'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.226103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1344/2677] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:13 2022] DELETE /identity/v3/users/373383825b3f4990b515d5305b840005 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:13.493309 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:13.494944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:13.508518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b5721d-a8e5-4fe0-9e67-ef938b5574a8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:13.566310 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:13.567258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:13.567659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:13.567986 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] PATH_INFO: `/v3/projects/5788a6ab29d04782acf6a9b28470dbe8` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:13.569320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5788a6ab29d04782acf6a9b28470dbe8)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:13.571458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:13.617730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5788a6ab29d04782acf6a9b28470dbe8', 'request_id': 'req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.624799 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5788a6ab29d04782acf6a9b28470dbe8', 'request_id': 'req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.630233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5788a6ab29d04782acf6a9b28470dbe8', 'request_id': 'req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.640688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] The token cache is being invalidate because project 5788a6ab29d04782acf6a9b28470dbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:13.640987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.641685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.643331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1334/2678] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:13 2022] DELETE /identity/v3/projects/5788a6ab29d04782acf6a9b28470dbe8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:13.647594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:13.649276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:13.662828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af4a8b-acd6-437c-9972-daf4b2db6a02 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:13.718314 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:13.719110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:13.719394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:13.719704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] PATH_INFO: `/v3/users/9e8b8cac94384a93a608247a921a2b42` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:13.720878 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8b8cac94384a93a608247a921a2b42)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:13.722788 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:13.767854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8b8cac94384a93a608247a921a2b42'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.768867 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8b8cac94384a93a608247a921a2b42'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.783142 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8b8cac94384a93a608247a921a2b42'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.794267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8b8cac94384a93a608247a921a2b42'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.794267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-efba21f2-5c43-4dbf-b383-b2537a82bfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8b8cac94384a93a608247a921a2b42'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:13.805146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1345/2679] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:13 2022] DELETE /identity/v3/users/9e8b8cac94384a93a608247a921a2b42 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:14.087218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.088779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:14.102037 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775dd0-8bb1-4113-abae-b9d5c2ebf597 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.159733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.160583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.160860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.161132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] PATH_INFO: `/v3/projects/d5b6e04d62474b8c85ac6741e0d14435` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.162367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b6e04d62474b8c85ac6741e0d14435)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.164581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.210280 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b6e04d62474b8c85ac6741e0d14435', 'request_id': 'req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:14.219297 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b6e04d62474b8c85ac6741e0d14435', 'request_id': 'req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:14.224477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b6e04d62474b8c85ac6741e0d14435', 'request_id': 'req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:14.235151 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] The token cache is being invalidate because project d5b6e04d62474b8c85ac6741e0d14435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:14.235437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:14.236084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-57c2b67d-ae0f-47e1-90dd-ae0ddc7408b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:14.237615 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1335/2680] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:14 2022] DELETE /identity/v3/projects/d5b6e04d62474b8c85ac6741e0d14435 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:14.242549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.242839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.243172 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.260603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:14.261977 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:14.322888 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1346/2681] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:14.331432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.331847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.332174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.350252 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:14.351785 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:14.361184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1336/2682] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:14.365569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.375586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fdc51-56e6-4339-823a-0309992b9442 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.380046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.380699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.380985 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.381267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.382011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:14.382320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.383960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.396237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1347/2683] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:09:14.401166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.410295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708cb2a-8bab-4d3b-a0f3-8e1143df4957 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.415122 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.415798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.416089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.416367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.417053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.418943 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.445251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1337/2684] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:14 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:14.449391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.459744 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdd720-b193-427f-a9f1-5efaf122e25e admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.513241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.513812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.514091 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.514385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.515722 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.517617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.537292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1348/2685] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:14 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:09:14.541537 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.551794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f249ec-f15a-4ff8-ad2a-986cbad94fb8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.556359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.557006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.557290 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.557566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.558285 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.560186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.570669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1338/2686] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:14.574720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.585498 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a3cbb-cd79-4d06-b8d9-ec5498c2dd4c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.590594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc7cbc-7841-4d18-9fa7-dfec1329f657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.591266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7cbc-7841-4d18-9fa7-dfec1329f657 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.591578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7cbc-7841-4d18-9fa7-dfec1329f657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.591863 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc7cbc-7841-4d18-9fa7-dfec1329f657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.592592 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc7cbc-7841-4d18-9fa7-dfec1329f657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.594203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc7cbc-7841-4d18-9fa7-dfec1329f657 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.604335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1349/2687] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:14.608648 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.618575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d8800-52db-4ea2-b997-41f82e4916b5 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.623282 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.624699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.624988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.625355 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] PATH_INFO: `/v3/projects/789facd4661545fca37854eccec55052/users/431338e0a072499aaffb4bd9f4781a5d/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.641089 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789facd4661545fca37854eccec55052, user_id=431338e0a072499aaffb4bd9f4781a5d, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.643761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.655992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1339/2688] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:14 2022] PUT /identity/v3/projects/789facd4661545fca37854eccec55052/users/431338e0a072499aaffb4bd9f4781a5d/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:14.666383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0a87-8107-4dcf-9cb1-6d22361e3b00 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.666855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0a87-8107-4dcf-9cb1-6d22361e3b00 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.666950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0a87-8107-4dcf-9cb1-6d22361e3b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.693932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-18ef0a87-8107-4dcf-9cb1-6d22361e3b00 None None] MFA Rules not processed for user `431338e0a072499aaffb4bd9f4781a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:14.695122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-18ef0a87-8107-4dcf-9cb1-6d22361e3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:14.756720 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1350/2689] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:14.767220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:14.769024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:14.824578 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6628c-4337-456d-9ed4-b4c51f0b1072 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:14.828215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:14.828845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:14.829124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:14.829394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:14.837471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:14.838935 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:14.848155 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1340/2690] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:17.233249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd5d25-c83a-4d0d-a825-d95583015d66 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:17.233696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd5d25-c83a-4d0d-a825-d95583015d66 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:17.234390 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd5d25-c83a-4d0d-a825-d95583015d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:17.254517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-39cd5d25-c83a-4d0d-a825-d95583015d66 None None] MFA Rules not processed for user `431338e0a072499aaffb4bd9f4781a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:17.255742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-39cd5d25-c83a-4d0d-a825-d95583015d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:17.262766 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1351/2691] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:39.037517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:39.038898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.102866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff985c8-1691-4b32-81b3-49b53dcaceca service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:39.107247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:39.108139 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.108416 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.108686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] PATH_INFO: `/v3/users/8bee76e455064368964ed022fffdf052` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.109856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bee76e455064368964ed022fffdf052)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:39.111788 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:39.153959 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bee76e455064368964ed022fffdf052'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.161021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bee76e455064368964ed022fffdf052'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.172478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bee76e455064368964ed022fffdf052'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.173114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bee76e455064368964ed022fffdf052'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.179610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bee76e455064368964ed022fffdf052'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.185270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1341/2692] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:39 2022] DELETE /identity/v3/users/8bee76e455064368964ed022fffdf052 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:39.190265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.190806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.190806 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.208180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:39.209920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.264407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1352/2693] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:39.274374 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:39.275814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.329829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164853ef-cb0e-42b5-9b7b-1dbd9536507a admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:39.333430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aafda-4133-470f-9a8c-8943247b20b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:39.334561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aafda-4133-470f-9a8c-8943247b20b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.334844 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aafda-4133-470f-9a8c-8943247b20b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.335120 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aafda-4133-470f-9a8c-8943247b20b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.343846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aafda-4133-470f-9a8c-8943247b20b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:39.345248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aafda-4133-470f-9a8c-8943247b20b1 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:39.354962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1342/2694] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:39.611097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:39.613138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.628485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659990-ad46-410d-999e-899fd9e02ac7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:39.633783 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:39.634646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.634927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.635995 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] PATH_INFO: `/v3/projects/a9d09203ab054561af7ff9236da15cee` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.637555 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d09203ab054561af7ff9236da15cee)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:39.639467 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:39.687370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d09203ab054561af7ff9236da15cee', 'request_id': 'req-204f5c0c-9e70-4a7e-993f-57e592b2a902'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.693839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d09203ab054561af7ff9236da15cee', 'request_id': 'req-204f5c0c-9e70-4a7e-993f-57e592b2a902'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.699202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d09203ab054561af7ff9236da15cee', 'request_id': 'req-204f5c0c-9e70-4a7e-993f-57e592b2a902'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.712751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] The token cache is being invalidate because project a9d09203ab054561af7ff9236da15cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:39.712751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.713297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-204f5c0c-9e70-4a7e-993f-57e592b2a902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:39.717927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1353/2695] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:39 2022] DELETE /identity/v3/projects/a9d09203ab054561af7ff9236da15cee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:39.719929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150bae-56c7-4097-b03e-d28fb99481f3 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.720233 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150bae-56c7-4097-b03e-d28fb99481f3 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.720523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3150bae-56c7-4097-b03e-d28fb99481f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.742279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-d3150bae-56c7-4097-b03e-d28fb99481f3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:39.743483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-d3150bae-56c7-4097-b03e-d28fb99481f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.779388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.779780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.780129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.798953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:39.800106 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.811794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1343/2696] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:39.857967 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1354/2697] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:39.873869 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.874239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.874440 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.893668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:39.894875 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.903688 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1344/2698] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:39.907828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:39.910858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:39.912206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:39.919381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33853d4-30ba-441f-bbc3-7d9f67944597 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:39.924203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:39.924862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.925150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.925427 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.926150 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:09:39.926457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:39.928107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:39.939477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1355/2699] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:09:39.944531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:39.956157 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f610f1b-43da-4fa3-a0fd-a46d88c7534f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:39.961452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:39.962095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.962382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.962663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.963461 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:39.965388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:39.980584 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9d670-48b2-492a-bf51-381fb6bc24f6 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:39.989142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:39.990754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:39.991047 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:39.991401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:39.998396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1356/2700] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:09:39 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:40.002537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.005066 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.006730 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.018886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1345/2701] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:09:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 29 16:09:40.071737 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c891-a0aa-4a11-88bd-365c95f1b420 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.078251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.078430 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.078689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.078964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.080448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.081959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.103294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1357/2702] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:09:40 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:09:40.107533 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.117916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7733472-d8f1-483d-a45d-40e1fb426784 service swift] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.123260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.124182 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.124471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.124735 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.125574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.127249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.137728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1346/2703] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:40.141485 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.152254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb4787-1786-470f-9caf-67248cd9fc3f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.156882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941328c-315e-4606-b6ef-ddcf03d67780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.157539 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941328c-315e-4606-b6ef-ddcf03d67780 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.157821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941328c-315e-4606-b6ef-ddcf03d67780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.158097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941328c-315e-4606-b6ef-ddcf03d67780 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.158827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941328c-315e-4606-b6ef-ddcf03d67780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.160454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941328c-315e-4606-b6ef-ddcf03d67780 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.171117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1358/2704] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:09:40.175204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.184889 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f176b-ee92-4d82-9397-182989cdd148 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.191039 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.191955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.192243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.192523 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] PATH_INFO: `/v3/projects/4ac16964b2604d2492c8a6963d74282a/users/7e0d392d5e404ababfe648c44403f125/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.208227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac16964b2604d2492c8a6963d74282a, user_id=7e0d392d5e404ababfe648c44403f125, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.211320 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.224672 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1347/2705] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:09:40 2022] PUT /identity/v3/projects/4ac16964b2604d2492c8a6963d74282a/users/7e0d392d5e404ababfe648c44403f125/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:40.234618 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19866b7-d146-4f05-bfb1-d67e1041386b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.235111 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19866b7-d146-4f05-bfb1-d67e1041386b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.235220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19866b7-d146-4f05-bfb1-d67e1041386b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.263884 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a19866b7-d146-4f05-bfb1-d67e1041386b None None] MFA Rules not processed for user `7e0d392d5e404ababfe648c44403f125`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:40.268187 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a19866b7-d146-4f05-bfb1-d67e1041386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:40.338131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1359/2706] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:09:40.349411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.351277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:40.408911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85f8d9-11a1-4309-a172-30c8415fcde1 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.412561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.413296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.413466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.413740 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.422162 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.423599 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.432811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1348/2707] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:40.531689 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ac4d6-4c3d-4e69-8506-264b1992c56e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.532038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ac4d6-4c3d-4e69-8506-264b1992c56e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.532493 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ac4d6-4c3d-4e69-8506-264b1992c56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.550825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-382ac4d6-4c3d-4e69-8506-264b1992c56e None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:40.551966 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-382ac4d6-4c3d-4e69-8506-264b1992c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:40.606612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1360/2708] 10.222.0.23 () {58 vars in 967 bytes} [Tue Mar 29 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:40.618955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.684308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba3803-4862-4858-85f7-ec436c8d1f93 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.690180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.690821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.691105 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.691382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.700083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:40.701663 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:40.710103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1349/2709] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:09:40.938230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d2a3-b5c5-415d-ac2b-c1184af22544 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.938523 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d2a3-b5c5-415d-ac2b-c1184af22544 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.938800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7d2a3-b5c5-415d-ac2b-c1184af22544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:40.956361 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9be7d2a3-b5c5-415d-ac2b-c1184af22544 None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:40.957531 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9be7d2a3-b5c5-415d-ac2b-c1184af22544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:40.964599 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1361/2710] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Mar 29 16:09:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:40.976432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:40.986587 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42ed7-0695-4c31-9dd1-7d5ce61c6b1e service swift] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:40.992076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:40.992708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:40.992988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:40.993265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:41.001157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:41.002700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:41.011009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1350/2711] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:09:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:09:41.488526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:41.488980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:41.489074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:41.506652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] MFA Rules not processed for user `982d0437047a4e6bb92851c916d6d4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:41.507893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:41.514824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1362/2712] 10.222.0.23 () {58 vars in 967 bytes} [Tue Mar 29 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:41.527294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:41.537613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7a71-f72b-4507-b372-b580997bad53 service swift] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:41.542744 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed14f3-30b2-4e48-84e7-146cc3705c44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7152e01448494ebd98eb204c3e602a77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:41.543381 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed14f3-30b2-4e48-84e7-146cc3705c44 service swift] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:41.543697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed14f3-30b2-4e48-84e7-146cc3705c44 service swift] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:41.543976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed14f3-30b2-4e48-84e7-146cc3705c44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:41.551839 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed14f3-30b2-4e48-84e7-146cc3705c44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:41.553921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed14f3-30b2-4e48-84e7-146cc3705c44 service swift] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:41.561639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1351/2713] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Mar 29 16:09:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 29 16:09:46.878344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:46.879841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:46.947064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896bf02-ae41-4d1c-a0dc-bc05509b8b1d None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:46.953310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:46.954471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:46.954915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:46.955290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] PATH_INFO: `/v3/users/431338e0a072499aaffb4bd9f4781a5d` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:46.956622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=431338e0a072499aaffb4bd9f4781a5d)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:46.960499 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:47.008217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431338e0a072499aaffb4bd9f4781a5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.009053 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431338e0a072499aaffb4bd9f4781a5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.020678 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431338e0a072499aaffb4bd9f4781a5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.027954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431338e0a072499aaffb4bd9f4781a5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.028570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431338e0a072499aaffb4bd9f4781a5d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.040628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1363/2714] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:46 2022] DELETE /identity/v3/users/431338e0a072499aaffb4bd9f4781a5d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:47.045228 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:47.045747 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:47.045901 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:47.063973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:47.065231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:47.124485 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1352/2715] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:47.134457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:47.135871 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:47.190060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3f15f-a6ef-4e64-bed2-f1328ff037cb admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:47.193656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:47.194874 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:47.195180 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:47.195458 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:47.204307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:47.205681 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:47.214770 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1364/2716] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:47.379422 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:47.381238 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:47.396008 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f3fe2-d318-4b3a-9012-03199576e388 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:47.402209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:47.403279 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:47.403858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:47.404225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] PATH_INFO: `/v3/projects/789facd4661545fca37854eccec55052` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:47.405630 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=789facd4661545fca37854eccec55052)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:47.408042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:47.456950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789facd4661545fca37854eccec55052', 'request_id': 'req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.463667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789facd4661545fca37854eccec55052', 'request_id': 'req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.468918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789facd4661545fca37854eccec55052', 'request_id': 'req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.480248 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] The token cache is being invalidate because project 789facd4661545fca37854eccec55052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:47.480540 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.481204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b47c4a5-26b0-4b14-ae18-6c657cdc7d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:47.482732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1353/2717] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:47 2022] DELETE /identity/v3/projects/789facd4661545fca37854eccec55052 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:48.465519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:48.466942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:48.479236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add778e4-7093-472d-bd92-17884e6d0b03 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:48.531780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:48.532642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:48.532927 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:48.533206 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] PATH_INFO: `/v3/users/7e0d392d5e404ababfe648c44403f125` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:48.534371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0d392d5e404ababfe648c44403f125)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:48.536325 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:48.579655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0d392d5e404ababfe648c44403f125'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:48.580300 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0d392d5e404ababfe648c44403f125'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:48.591758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0d392d5e404ababfe648c44403f125'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:48.598841 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0d392d5e404ababfe648c44403f125'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:48.599502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0d392d5e404ababfe648c44403f125'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:48.611211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1365/2718] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:09:48 2022] DELETE /identity/v3/users/7e0d392d5e404ababfe648c44403f125 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:48.616328 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:48.616851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:48.616952 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:48.634471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:48.635694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:48.691106 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1354/2719] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:48.701069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:48.702393 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:48.757965 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacd0b4-29ef-4016-b666-6334929064ad admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:48.761602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f07f9b-d19c-44cc-8962-d586eb549602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:48.762246 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f07f9b-d19c-44cc-8962-d586eb549602 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:48.762530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f07f9b-d19c-44cc-8962-d586eb549602 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:48.762807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f07f9b-d19c-44cc-8962-d586eb549602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:48.771825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f07f9b-d19c-44cc-8962-d586eb549602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:48.773822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f07f9b-d19c-44cc-8962-d586eb549602 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:48.783015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1366/2720] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:49.032603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:49.034142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:49.047629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3ff49-bc09-446d-9308-7f2346e92ba9 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:49.052265 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:49.053134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:49.053960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:49.054239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] PATH_INFO: `/v3/projects/4ac16964b2604d2492c8a6963d74282a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:49.055430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac16964b2604d2492c8a6963d74282a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:49.058126 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:49.106466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac16964b2604d2492c8a6963d74282a', 'request_id': 'req-48c62206-ae8c-40fc-89fb-527c628a5daa'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:49.114056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac16964b2604d2492c8a6963d74282a', 'request_id': 'req-48c62206-ae8c-40fc-89fb-527c628a5daa'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:49.120107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac16964b2604d2492c8a6963d74282a', 'request_id': 'req-48c62206-ae8c-40fc-89fb-527c628a5daa'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:49.130687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] The token cache is being invalidate because project 4ac16964b2604d2492c8a6963d74282a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:09:49.130977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:49.131682 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:09:49.133710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1355/2721] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:09:49 2022] DELETE /identity/v3/projects/4ac16964b2604d2492c8a6963d74282a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:09:53.621159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:53.621660 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:53.621789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:53.638153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] MFA Rules not processed for user `fd393753fd81497391a83b42cae7e1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:09:53.639354 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:53.691099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1367/2722] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:09:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:09:53.987049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:53.988460 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:54.042762 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62206-ae8c-40fc-89fb-527c628a5daa admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:54.046334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:54.046960 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:54.047241 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:54.047513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:54.049250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:54.058759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:54.060205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:54.068351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1356/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:54.380859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:54.382254 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:54.449799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb945ae-f0ca-4cc2-99d6-a04153583ff1 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:54.454680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:54.455315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:54.455627 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:54.455905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:54.457631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:54.468880 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:54.470420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:54.480394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1368/2724] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:09:55.293335 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:09:55.294992 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:55.306184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b1409-30cc-4c62-8c17-c6783d817581 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:09:55.309798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:09:55.310430 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:09:55.310736 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:09:55.311018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:09:55.312773 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:09:55.323871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:09:55.325361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:09:55.334489 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1357/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:09:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:10:02.242932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:10:02.245199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:10:02.316816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bf564-715e-485a-9f64-8fb61f39eb02 service placement] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:10:02.322868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:10:02.323518 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:10:02.323838 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:10:02.324120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:10:02.325882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:10:02.338226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:10:02.339771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:10:02.349922 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1369/2726] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:10:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:10:06.323610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:10:06.325331 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:10:06.341227 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed8899-e8d3-4adc-a8f5-d08df99be9eb service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:10:06.346608 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:10:06.347362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:10:06.347685 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:10:06.347966 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:10:06.349743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:10:06.362404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:10:06.364054 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:10:06.374556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1358/2727] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:10:54.072098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:10:54.129910 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234d7a-25de-48d9-a7fa-631d29e8f065 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:10:54.134931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:10:54.135612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:10:54.135893 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:10:54.136167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:10:54.137909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:10:54.169381 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:10:54.170959 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:10:54.180584 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1370/2728] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:11:50.979907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:51.017553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670eae0-905d-414e-bc25-1e9325dbbf8e service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:51.021136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:51.021765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:51.022048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:51.022323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:51.024091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:51.107127 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:51.108731 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:51.131513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1359/2729] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:11:54.039230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.040740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:54.055307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43e8c-a1f3-4cc4-88dd-db07d759e8bd service placement] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.060694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.061606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.061887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.062164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] PATH_INFO: `/v3/users/fd393753fd81497391a83b42cae7e1c8` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.063983 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd393753fd81497391a83b42cae7e1c8)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.065933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.118014 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd393753fd81497391a83b42cae7e1c8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.118750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd393753fd81497391a83b42cae7e1c8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.131905 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd393753fd81497391a83b42cae7e1c8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.139616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd393753fd81497391a83b42cae7e1c8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.140294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-c1235039-a9d1-4a99-9921-4fd6bb797e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd393753fd81497391a83b42cae7e1c8'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.152798 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1371/2730] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:11:54 2022] DELETE /identity/v3/users/fd393753fd81497391a83b42cae7e1c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:54.324364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.334501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0e44-767d-4807-9a70-920c031e4416 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.389474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.390330 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.390639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.390914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] PATH_INFO: `/v3/projects/42076e0f315f45bfa46a75434188626f` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.392109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42076e0f315f45bfa46a75434188626f)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.393991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.442055 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42076e0f315f45bfa46a75434188626f', 'request_id': 'req-5b9b588e-4cdb-4580-90c9-ebb7020b7342'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.448625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42076e0f315f45bfa46a75434188626f', 'request_id': 'req-5b9b588e-4cdb-4580-90c9-ebb7020b7342'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.454131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42076e0f315f45bfa46a75434188626f', 'request_id': 'req-5b9b588e-4cdb-4580-90c9-ebb7020b7342'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.464390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] The token cache is being invalidate because project 42076e0f315f45bfa46a75434188626f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:11:54.464675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.465296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b9b588e-4cdb-4580-90c9-ebb7020b7342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:54.466797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1360/2731] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:11:54 2022] DELETE /identity/v3/projects/42076e0f315f45bfa46a75434188626f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:54.472154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.472442 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.472719 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.526600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:54.527858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:54.584823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1372/2732] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:54.592910 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.593204 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.593488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.611200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:54.612419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:54.620116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1361/2733] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:54.624332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.634267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1286c5-1b45-4666-9c5a-d39f77b1c177 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.638734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.639380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.639699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.639978 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.640731 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:11:54.641571 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.643169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.654154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1373/2734] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:11:54.658206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.667053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405213-2b33-4e32-b4bd-2680e1d36685 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.671707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.672345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.672629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.672907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.673583 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.675455 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.699838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1362/2735] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:11:54 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:11:54.704595 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.714679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dda71e-9c4e-4c52-9e0c-5f9a4b8d059c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.772791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.773465 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.773750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.774028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.774727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.776677 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.795320 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1374/2736] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:11:54 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:11:54.799851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.809981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fc5f-b021-4526-bb32-b605d207d759 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.817982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.819649 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.819944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.820242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.820961 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.822561 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.833184 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1363/2737] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:54.837202 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.846925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bc1bb-6fcf-448d-8a14-be74c770d210 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.851446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbd11c-bf3c-4a26-aa3f-adb7ffbfe183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.852144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbd11c-bf3c-4a26-aa3f-adb7ffbfe183 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.852429 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbd11c-bf3c-4a26-aa3f-adb7ffbfe183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.852708 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbd11c-bf3c-4a26-aa3f-adb7ffbfe183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.853424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbd11c-bf3c-4a26-aa3f-adb7ffbfe183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.855055 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbd11c-bf3c-4a26-aa3f-adb7ffbfe183 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.865035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1375/2738] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:54.868790 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:54.878317 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19bb7d-5fe1-41b1-af57-2aedd5f6a065 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:54.883067 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:54.883962 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.884270 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.884547 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] PATH_INFO: `/v3/projects/7fa5748d12084a258e3b35470cb0d76d/users/6df93f1c5dfc44cb85d20dfa29e19edc/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.898911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa5748d12084a258e3b35470cb0d76d, user_id=6df93f1c5dfc44cb85d20dfa29e19edc, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:54.901574 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:54.914897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1364/2739] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:11:54 2022] PUT /identity/v3/projects/7fa5748d12084a258e3b35470cb0d76d/users/6df93f1c5dfc44cb85d20dfa29e19edc/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:11:54.924742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:54.925033 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:54.925309 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:54.950365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] MFA Rules not processed for user `6df93f1c5dfc44cb85d20dfa29e19edc`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:54.951824 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:55.015169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1376/2740] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:55.019623 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.078867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2be7e-d4f3-43f7-a918-32d8d0afec1c admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.086352 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.087406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.087926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.088210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.088913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.091667 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.124509 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1365/2741] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:11:55 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:11:55.129076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.139549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f8b9-de45-46a8-9546-05a78f0f456e None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.192527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.193193 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.193475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.193751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.194439 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.196379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.214949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1377/2742] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:11:55 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:11:55.219577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.229673 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118da1c-2de9-46cb-9e2b-81d54c443319 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.234234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.235409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.235723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.236000 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.236713 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.238287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.248318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1366/2743] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:55.252366 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.262177 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53868b-df73-456c-ab23-3dc32441b7bd admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.266917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.267821 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.268105 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.268551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] PATH_INFO: `/v3/projects/386c4c57189e4d95bf4dc79a56d9e21e/users/0e6fd9e2b2474aedabbca0465e271c69/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.283241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386c4c57189e4d95bf4dc79a56d9e21e, user_id=0e6fd9e2b2474aedabbca0465e271c69, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.285915 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.298785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1378/2744] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:11:55 2022] PUT /identity/v3/projects/386c4c57189e4d95bf4dc79a56d9e21e/users/0e6fd9e2b2474aedabbca0465e271c69/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:55.302572 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.312284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde31c-289f-42f6-89b7-2d7c676cb82d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.366099 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892fe41-6513-4e53-b86e-e7544d1d259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.366712 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892fe41-6513-4e53-b86e-e7544d1d259d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.366953 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892fe41-6513-4e53-b86e-e7544d1d259d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.367231 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892fe41-6513-4e53-b86e-e7544d1d259d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.367977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892fe41-6513-4e53-b86e-e7544d1d259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.369588 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892fe41-6513-4e53-b86e-e7544d1d259d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.381243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1367/2745] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:55.385457 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.399398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d92c9-f4fd-4a66-8cc8-42f19075d501 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.405189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.406069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.406849 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.407123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] PATH_INFO: `/v3/projects/386c4c57189e4d95bf4dc79a56d9e21e/users/0e6fd9e2b2474aedabbca0465e271c69/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.409135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=386c4c57189e4d95bf4dc79a56d9e21e, user_id=0e6fd9e2b2474aedabbca0465e271c69, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.411794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.421858 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1379/2746] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:11:55 2022] PUT /identity/v3/projects/386c4c57189e4d95bf4dc79a56d9e21e/users/0e6fd9e2b2474aedabbca0465e271c69/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:55.433347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.433636 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.433913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.461625 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] MFA Rules not processed for user `0e6fd9e2b2474aedabbca0465e271c69`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:55.462797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:55.526668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1368/2747] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:11:55.538527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:55.540253 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:55.596308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfa419-c562-4139-a92c-fe6284052cdc admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:55.599953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187cd2a-bc96-4f66-92f7-bc8fa6e4d2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:55.600601 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187cd2a-bc96-4f66-92f7-bc8fa6e4d2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:55.600885 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187cd2a-bc96-4f66-92f7-bc8fa6e4d2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:55.601164 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187cd2a-bc96-4f66-92f7-bc8fa6e4d2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:55.610145 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187cd2a-bc96-4f66-92f7-bc8fa6e4d2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:55.611658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e187cd2a-bc96-4f66-92f7-bc8fa6e4d2f3 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:55.620937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1380/2748] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:11:55.977101 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:56.036457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00714f8-5153-45cc-8750-66a6afc76f1b None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:56.040880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:56.041728 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:56.042013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:56.042287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] PATH_INFO: `/v3/users/6df93f1c5dfc44cb85d20dfa29e19edc` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:56.043445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df93f1c5dfc44cb85d20dfa29e19edc)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:56.045365 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:56.091619 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df93f1c5dfc44cb85d20dfa29e19edc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.098764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df93f1c5dfc44cb85d20dfa29e19edc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.110260 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df93f1c5dfc44cb85d20dfa29e19edc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.110906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df93f1c5dfc44cb85d20dfa29e19edc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.117738 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df93f1c5dfc44cb85d20dfa29e19edc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.123354 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1369/2749] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:11:55 2022] DELETE /identity/v3/users/6df93f1c5dfc44cb85d20dfa29e19edc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:56.128348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:56.128709 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:56.128925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:56.146589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:56.147811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:56.202526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1381/2750] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:56.212478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:56.213855 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:56.279206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e5310-c816-4263-b6fc-9f704e520177 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:56.282937 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:56.283601 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:56.283887 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:56.284163 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:56.292854 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:56.294275 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:56.303852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1370/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:11:56.559850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:56.561276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:56.583761 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f69b96-a847-4a34-bb27-618f0dffc748 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:56.589440 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:56.590316 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:56.590593 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:56.590889 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] PATH_INFO: `/v3/projects/7fa5748d12084a258e3b35470cb0d76d` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:56.592078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa5748d12084a258e3b35470cb0d76d)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:56.595185 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:56.640607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa5748d12084a258e3b35470cb0d76d', 'request_id': 'req-557c131f-1441-4c8b-bc99-c7686765deee'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.647194 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa5748d12084a258e3b35470cb0d76d', 'request_id': 'req-557c131f-1441-4c8b-bc99-c7686765deee'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.652486 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa5748d12084a258e3b35470cb0d76d', 'request_id': 'req-557c131f-1441-4c8b-bc99-c7686765deee'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.664069 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] The token cache is being invalidate because project 7fa5748d12084a258e3b35470cb0d76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:11:56.664352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.664962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.666459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1382/2752] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:11:56 2022] DELETE /identity/v3/projects/7fa5748d12084a258e3b35470cb0d76d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:56.670491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:56.680026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5545-f2eb-475a-b801-8fc713a17a71 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:56.735243 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:56.736143 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:56.736429 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:56.736707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] PATH_INFO: `/v3/users/0e6fd9e2b2474aedabbca0465e271c69` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:56.737888 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6fd9e2b2474aedabbca0465e271c69)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:56.739838 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:56.785051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6fd9e2b2474aedabbca0465e271c69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.791769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6fd9e2b2474aedabbca0465e271c69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.802899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6fd9e2b2474aedabbca0465e271c69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.803553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6fd9e2b2474aedabbca0465e271c69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.809988 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-7835d86d-ee92-41ba-83f8-874b90249939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6fd9e2b2474aedabbca0465e271c69'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:56.816528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1371/2753] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:11:56 2022] DELETE /identity/v3/users/0e6fd9e2b2474aedabbca0465e271c69 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:57.072799 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.074230 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:57.088216 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c131f-1441-4c8b-bc99-c7686765deee admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.150382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.151240 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.151540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.151829 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] PATH_INFO: `/v3/projects/386c4c57189e4d95bf4dc79a56d9e21e` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.153005 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386c4c57189e4d95bf4dc79a56d9e21e)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.154917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.198303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386c4c57189e4d95bf4dc79a56d9e21e', 'request_id': 'req-8fa67c64-7a82-4079-95ad-11cfaa11f518'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:57.204356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386c4c57189e4d95bf4dc79a56d9e21e', 'request_id': 'req-8fa67c64-7a82-4079-95ad-11cfaa11f518'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:57.209602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386c4c57189e4d95bf4dc79a56d9e21e', 'request_id': 'req-8fa67c64-7a82-4079-95ad-11cfaa11f518'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:57.221621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] The token cache is being invalidate because project 386c4c57189e4d95bf4dc79a56d9e21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:11:57.221903 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:57.222528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-8fa67c64-7a82-4079-95ad-11cfaa11f518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:57.224167 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1383/2754] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:11:57 2022] DELETE /identity/v3/projects/386c4c57189e4d95bf4dc79a56d9e21e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:57.229027 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.229313 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.229586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.247049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:57.248232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:57.303510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1372/2755] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:57.311266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.311591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.311876 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.330346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:57.331551 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:57.339311 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1384/2756] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:57.343446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.353235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7584f-6a77-40d3-9e6a-5d7770395efd None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.357698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.358332 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.358612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.358883 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.360235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:11:57.360542 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.362160 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.373060 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1373/2757] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:11:57.377141 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.385968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ead2b9-82be-40fe-84a6-a756f0b43f0c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.390549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.391189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.391475 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.391785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.392466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.394359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.426462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1385/2758] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:11:57.430577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.440525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ee4eb-bcaa-4eff-ab1d-e86e5825b441 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.495185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.495906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.496195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.496474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.497166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.499077 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.518080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1374/2759] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:11:57.522126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.540222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f0c86-bcd1-4ab0-b1fe-a21160ffc042 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.545718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.546377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.546663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.546942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.548285 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.549891 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.560028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1386/2760] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:57.564339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.574149 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ec819-e9f9-4854-ab9e-570bf8947788 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.579624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f4a885-c9de-464b-a355-a2f05661be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.580283 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a885-c9de-464b-a355-a2f05661be1f admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.580571 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a885-c9de-464b-a355-a2f05661be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.580880 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f4a885-c9de-464b-a355-a2f05661be1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.581602 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a885-c9de-464b-a355-a2f05661be1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.583187 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f4a885-c9de-464b-a355-a2f05661be1f admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.593256 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1375/2761] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:57.597334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.607153 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db70de2-4671-4844-9f5e-05ebcc408dac admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.611800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.612666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.612950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.613225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] PATH_INFO: `/v3/projects/c85761acbc0c4a3bab7dca621c0af2bf/users/0a85d25198014c9eb783b0b36ff4062c/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.627810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85761acbc0c4a3bab7dca621c0af2bf, user_id=0a85d25198014c9eb783b0b36ff4062c, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.630446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.643034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1387/2762] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:11:57 2022] PUT /identity/v3/projects/c85761acbc0c4a3bab7dca621c0af2bf/users/0a85d25198014c9eb783b0b36ff4062c/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:11:57.652939 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.653234 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.653516 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.679596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] MFA Rules not processed for user `0a85d25198014c9eb783b0b36ff4062c`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:57.680786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:57.744870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1376/2763] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:57.749576 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.814830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74f69-486b-41df-9ea6-08e04ab9346b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.819508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.820189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.820474 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.820754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.821444 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.823348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.847340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1388/2764] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/projects => generated 369 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:11:57.851446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.862288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee05d01-77f6-45c8-ac67-82cee22ae82a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.915217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.915973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.916253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.916536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.917254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.919304 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.938798 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1377/2765] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:11:57 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:11:57.942773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.953078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5d1c1-3231-4852-9edf-4eff4934c90d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.957825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.958471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.958755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.959031 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:57.959785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:57.961383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:57.970866 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1389/2766] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:57.974737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:57.984373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075dea1-395e-4575-ba25-1d462ddaac88 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:57.989406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:57.990269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:57.990549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:57.990823 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] PATH_INFO: `/v3/projects/8afb7782518142458a09566cd366b53e/users/36dc434922fb4bf98c64d179538cf991/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:58.005475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8afb7782518142458a09566cd366b53e, user_id=36dc434922fb4bf98c64d179538cf991, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:58.008079 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:58.020950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1378/2767] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:11:57 2022] PUT /identity/v3/projects/8afb7782518142458a09566cd366b53e/users/36dc434922fb4bf98c64d179538cf991/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:58.024918 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:58.034566 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9dc1c-36a4-49d4-9ca3-8e4696e5238f admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:58.089137 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef89797-bec9-4d35-bf92-377537f63012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:58.089794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89797-bec9-4d35-bf92-377537f63012 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:58.090078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89797-bec9-4d35-bf92-377537f63012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:58.090355 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89797-bec9-4d35-bf92-377537f63012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:58.091075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef89797-bec9-4d35-bf92-377537f63012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:58.092706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef89797-bec9-4d35-bf92-377537f63012 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:58.102765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1390/2768] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:11:58.107206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:58.117739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a358c-549c-4c3f-b6a4-fb6a9294d4a3 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:58.122371 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:58.123257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:58.123546 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:58.123834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] PATH_INFO: `/v3/projects/8afb7782518142458a09566cd366b53e/users/36dc434922fb4bf98c64d179538cf991/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:58.125804 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8afb7782518142458a09566cd366b53e, user_id=36dc434922fb4bf98c64d179538cf991, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:58.128463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:58.138380 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1379/2769] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:11:58 2022] PUT /identity/v3/projects/8afb7782518142458a09566cd366b53e/users/36dc434922fb4bf98c64d179538cf991/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:58.149481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:58.149773 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:58.150046 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:58.175732 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] MFA Rules not processed for user `36dc434922fb4bf98c64d179538cf991`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:58.176909 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:58.240302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1391/2770] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:58.251569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:58.253249 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:58.307116 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526867e-7877-42ce-aab1-ac86b1e805a1 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:58.310633 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389d4e-d0ba-4e9e-a542-ef69a8d4bfd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:58.311269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389d4e-d0ba-4e9e-a542-ef69a8d4bfd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:58.311581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389d4e-d0ba-4e9e-a542-ef69a8d4bfd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:58.311866 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389d4e-d0ba-4e9e-a542-ef69a8d4bfd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:58.321466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389d4e-d0ba-4e9e-a542-ef69a8d4bfd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:58.322899 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389d4e-d0ba-4e9e-a542-ef69a8d4bfd3 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:58.332977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1380/2771] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:11:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:11:59.575433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:59.634505 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd01c-050f-4ade-8e62-99c454039438 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:59.638929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:59.639813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:59.640117 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:59.640367 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] PATH_INFO: `/v3/users/0a85d25198014c9eb783b0b36ff4062c` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:59.641530 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a85d25198014c9eb783b0b36ff4062c)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:59.643423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:59.687392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a85d25198014c9eb783b0b36ff4062c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:59.688084 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a85d25198014c9eb783b0b36ff4062c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:59.699214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a85d25198014c9eb783b0b36ff4062c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:59.706676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a85d25198014c9eb783b0b36ff4062c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:59.707504 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a85d25198014c9eb783b0b36ff4062c'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:11:59.719850 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1392/2772] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:11:59 2022] DELETE /identity/v3/users/0a85d25198014c9eb783b0b36ff4062c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:11:59.724407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:59.724886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:59.725017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:59.742549 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:11:59.743764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:59.800841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1381/2773] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:11:59.810448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:11:59.811886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:11:59.870332 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e16994-13dc-49ad-8d53-77684d0fc389 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:11:59.873817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:11:59.874462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:11:59.874742 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:11:59.875016 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:11:59.886267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:11:59.887727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:11:59.896875 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1393/2774] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:00.192437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:00.193856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:00.207837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94867-76b3-47b8-b51a-cc1def43192d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:00.213257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:00.214179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:00.214390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:00.214684 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] PATH_INFO: `/v3/projects/c85761acbc0c4a3bab7dca621c0af2bf` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:00.216025 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85761acbc0c4a3bab7dca621c0af2bf)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:00.217776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:00.262376 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85761acbc0c4a3bab7dca621c0af2bf', 'request_id': 'req-c83e1468-8da0-4120-aac1-b7f3eb81b1be'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.270258 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85761acbc0c4a3bab7dca621c0af2bf', 'request_id': 'req-c83e1468-8da0-4120-aac1-b7f3eb81b1be'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.276091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85761acbc0c4a3bab7dca621c0af2bf', 'request_id': 'req-c83e1468-8da0-4120-aac1-b7f3eb81b1be'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.288519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] The token cache is being invalidate because project c85761acbc0c4a3bab7dca621c0af2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:00.288809 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.289445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.290975 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1382/2775] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:00 2022] DELETE /identity/v3/projects/c85761acbc0c4a3bab7dca621c0af2bf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:00.295802 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:00.305162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b24b9-9859-4188-98f4-c79e38096522 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:00.370590 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:00.371857 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:00.372232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:00.372611 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] PATH_INFO: `/v3/users/36dc434922fb4bf98c64d179538cf991` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:00.374222 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36dc434922fb4bf98c64d179538cf991)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:00.377561 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:00.421424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36dc434922fb4bf98c64d179538cf991'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.421992 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36dc434922fb4bf98c64d179538cf991'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.433068 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36dc434922fb4bf98c64d179538cf991'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.440456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36dc434922fb4bf98c64d179538cf991'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.441072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-42224dcc-4c03-4f0d-a45e-1dafe0654a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36dc434922fb4bf98c64d179538cf991'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.453279 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1394/2776] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:12:00 2022] DELETE /identity/v3/users/36dc434922fb4bf98c64d179538cf991 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:00.720916 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:00.722357 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:00.736980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e1468-8da0-4120-aac1-b7f3eb81b1be admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:00.796924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:00.797818 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:00.798104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:00.798383 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] PATH_INFO: `/v3/projects/8afb7782518142458a09566cd366b53e` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:00.799573 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8afb7782518142458a09566cd366b53e)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:00.801483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:00.845505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8afb7782518142458a09566cd366b53e', 'request_id': 'req-f3a26962-0211-403b-9321-7239a588ee07'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.852979 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8afb7782518142458a09566cd366b53e', 'request_id': 'req-f3a26962-0211-403b-9321-7239a588ee07'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.869401 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8afb7782518142458a09566cd366b53e', 'request_id': 'req-f3a26962-0211-403b-9321-7239a588ee07'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.880723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] The token cache is being invalidate because project 8afb7782518142458a09566cd366b53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:00.881009 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.881737 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f3a26962-0211-403b-9321-7239a588ee07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:00.883262 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1383/2777] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:00 2022] DELETE /identity/v3/projects/8afb7782518142458a09566cd366b53e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:00.888126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:00.888613 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:00.888717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:00.905923 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:00.907126 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:00.964012 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1395/2778] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:00.971932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:00.972225 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:00.972506 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:00.990903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:00.992138 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:00.999999 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1384/2779] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:01.004189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.013939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d93fc-86cd-42b7-8d3d-bdde8b796bc3 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.019088 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.019813 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.020100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.020466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.021250 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79739) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:12:01.021562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.023245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.035236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1396/2780] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:12:01.039746 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.048696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63754ba-90d5-4ec6-8d31-6781c62d5f24 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.053336 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.053980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.054263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.054541 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.055236 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.057166 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.083056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1385/2781] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:01.087258 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.097516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb430a3-2f48-4fa3-b246-94a960abec3d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.166855 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.167562 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.167859 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.168133 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.168856 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.170780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.190794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1397/2782] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:01.194907 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.205969 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caca630-f327-41f0-b227-70cf9b6d0d61 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.216947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.216947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.216947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.216947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.217359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.217359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.224063 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1386/2783] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:01.227914 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.237502 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ce62-75dc-48c8-b388-aa0fbbaf2097 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.241956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447753f4-5170-4191-9a8f-740b821eafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.242600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447753f4-5170-4191-9a8f-740b821eafbd admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.242881 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447753f4-5170-4191-9a8f-740b821eafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.243155 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447753f4-5170-4191-9a8f-740b821eafbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.243902 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447753f4-5170-4191-9a8f-740b821eafbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.245479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447753f4-5170-4191-9a8f-740b821eafbd admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.259924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1398/2784] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:01.263789 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.274001 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251dca-fb87-480f-903b-0bf74e555832 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.278604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.279465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.279787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.280072 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] PATH_INFO: `/v3/projects/fc479f0f1a7a4ad0847c5e2670391f9b/users/f4f620c227aa4d6ca091a29af30406a7/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.294763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc479f0f1a7a4ad0847c5e2670391f9b, user_id=f4f620c227aa4d6ca091a29af30406a7, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.297978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.309996 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1387/2785] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:01 2022] PUT /identity/v3/projects/fc479f0f1a7a4ad0847c5e2670391f9b/users/f4f620c227aa4d6ca091a29af30406a7/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:01.321810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.322102 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.322383 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.349099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] MFA Rules not processed for user `f4f620c227aa4d6ca091a29af30406a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:01.350329 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:01.412144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1399/2786] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:01.416617 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.475433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fb68c-2f75-48b6-83a9-b9875d02287d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.480104 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.480754 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.481040 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.481318 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.482004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.483944 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.509474 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1388/2787] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:12:01.513460 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.524008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb028f-b017-4352-aa7d-12b183020349 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.612245 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.612916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.613199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.613500 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.614205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.616223 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.636582 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1400/2788] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:01.640647 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.650777 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58d94c-e9ad-4490-9894-2fbb71caacbe admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.655363 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.656045 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.656334 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.656616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.657338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.658934 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.669062 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1389/2789] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:01.673341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.683227 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b721704-fb1b-42f9-a79a-6ab79254bf5c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.688425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf63e66-5943-4952-bf16-7f551fa2bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.689058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf63e66-5943-4952-bf16-7f551fa2bb99 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.689360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf63e66-5943-4952-bf16-7f551fa2bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.689612 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf63e66-5943-4952-bf16-7f551fa2bb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.690387 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf63e66-5943-4952-bf16-7f551fa2bb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.692094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf63e66-5943-4952-bf16-7f551fa2bb99 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.702672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1401/2790] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:01.706829 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.716631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c780-3330-4bee-ac70-2b7a712aa441 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.721298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.722164 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.722454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.722791 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] PATH_INFO: `/v3/projects/c6afd583890f47f3aa3efcd0309b9d31/users/d91f5b48176149ff829a4cdd80d777cf/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.737694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6afd583890f47f3aa3efcd0309b9d31, user_id=d91f5b48176149ff829a4cdd80d777cf, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.740739 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.754641 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1390/2791] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:01 2022] PUT /identity/v3/projects/c6afd583890f47f3aa3efcd0309b9d31/users/d91f5b48176149ff829a4cdd80d777cf/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:01.764980 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.765276 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.765554 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.805480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] MFA Rules not processed for user `d91f5b48176149ff829a4cdd80d777cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:01.806680 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:01.868127 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1402/2792] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:01.873034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.933215 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7317fbe-2f8d-474d-914f-33b0b2c8fe00 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:01.938495 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:01.939148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:01.939435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:01.939741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:01.940436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:01.942358 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:01.966477 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1391/2793] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:12:01.971020 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:01.981448 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d3d97-5635-48ed-b3b4-daa20b62ba6c None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.035293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.035917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.036203 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.036481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] PATH_INFO: `/v3/users` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.037199 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:02.039109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:02.057664 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1403/2794] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:01 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:02.061622 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:02.071783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5d56f-6b8f-409b-9301-9423ca5cb7ab admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.076525 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.077436 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.077718 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.077991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.078749 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:02.080373 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:02.090794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1392/2795] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:02.095419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:02.105419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca31e89-6093-4526-aff0-a2ae1f827655 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.110547 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.111416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.111730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.112008 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] PATH_INFO: `/v3/projects/c6fc27b00b074461ace587e077e1cc3d/users/d44beea5c984474ea67a7c38983965f2/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.126051 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fc27b00b074461ace587e077e1cc3d, user_id=d44beea5c984474ea67a7c38983965f2, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:02.128755 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:02.141263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1404/2796] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:02 2022] PUT /identity/v3/projects/c6fc27b00b074461ace587e077e1cc3d/users/d44beea5c984474ea67a7c38983965f2/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:02.145146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:02.155056 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50eed0-240f-48c9-adc0-8ae448eb8be0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.209782 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac54447-b515-423d-a3cd-de8662c30ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.210441 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac54447-b515-423d-a3cd-de8662c30ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.210727 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac54447-b515-423d-a3cd-de8662c30ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.211005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac54447-b515-423d-a3cd-de8662c30ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.211753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac54447-b515-423d-a3cd-de8662c30ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:02.213339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac54447-b515-423d-a3cd-de8662c30ea4 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:02.223131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1393/2797] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 29 16:12:02.227412 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:02.237407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfb3bc-bfd5-4cec-89d7-9b6f9469ef1b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.241924 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.242796 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.243076 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.243352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] PATH_INFO: `/v3/projects/c6fc27b00b074461ace587e077e1cc3d/users/d44beea5c984474ea67a7c38983965f2/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.245587 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6fc27b00b074461ace587e077e1cc3d, user_id=d44beea5c984474ea67a7c38983965f2, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:02.248280 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:02.258192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1405/2798] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:02 2022] PUT /identity/v3/projects/c6fc27b00b074461ace587e077e1cc3d/users/d44beea5c984474ea67a7c38983965f2/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:12:02.269631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.269925 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.270210 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.296932 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] MFA Rules not processed for user `d44beea5c984474ea67a7c38983965f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:02.298158 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:02.366675 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1394/2799] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:02.377529 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:02.379205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:02.438149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5729cdc-b360-44d8-88d3-d897598f2418 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.441735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.442376 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.442656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.442929 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:02.451655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:02.453350 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:02.462917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1406/2800] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:02.936660 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:02.938042 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:02.949661 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490bb37-340f-4966-8f54-f87bb1201ae4 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:02.953445 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:02.954628 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:02.954917 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:02.955200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:03.008660 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:03.010094 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:03.019253 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1395/2801] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:06.943491 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:06.951822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c320c8c-05be-4d1f-87d3-6fbd7368d5b7 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:06.956377 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf24a8-661b-4df9-90e0-9ebca7ebd06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:06.957038 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf24a8-661b-4df9-90e0-9ebca7ebd06f service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:06.957323 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf24a8-661b-4df9-90e0-9ebca7ebd06f service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:06.957628 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf24a8-661b-4df9-90e0-9ebca7ebd06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:07.011356 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf24a8-661b-4df9-90e0-9ebca7ebd06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:07.012763 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf24a8-661b-4df9-90e0-9ebca7ebd06f service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:07.022214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1407/2802] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:08.999295 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:09.058240 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bb1df-60b8-4e9b-8913-36be6c728659 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:09.062656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:09.064102 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:09.064405 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:09.064806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] PATH_INFO: `/v3/users/f4f620c227aa4d6ca091a29af30406a7` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:09.065976 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f620c227aa4d6ca091a29af30406a7)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:09.067909 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:09.112109 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f620c227aa4d6ca091a29af30406a7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.119311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f620c227aa4d6ca091a29af30406a7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.131468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f620c227aa4d6ca091a29af30406a7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.132148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f620c227aa4d6ca091a29af30406a7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.138902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f620c227aa4d6ca091a29af30406a7'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.144741 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1396/2803] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:12:08 2022] DELETE /identity/v3/users/f4f620c227aa4d6ca091a29af30406a7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:09.149191 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:09.149699 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:09.149801 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:09.166074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:09.167287 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:09.223644 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1408/2804] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:09.233368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:09.234769 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:09.289760 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c49f03-749a-4d02-b3d9-cd2cd1c6a90b admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:09.293471 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:09.294108 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:09.294394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:09.294676 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:09.303912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:09.305344 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:09.315188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1397/2805] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:12:09.566953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:09.568406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:09.583239 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0fa16-f2ea-41bf-9e95-920d522c9ce7 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:09.588646 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:09.589622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:09.589816 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:09.590183 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] PATH_INFO: `/v3/projects/fc479f0f1a7a4ad0847c5e2670391f9b` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:09.591273 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc479f0f1a7a4ad0847c5e2670391f9b)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:09.600938 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:09.646267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc479f0f1a7a4ad0847c5e2670391f9b', 'request_id': 'req-b68cdead-c2ef-4f92-bdf2-6bde612226b6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.652178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc479f0f1a7a4ad0847c5e2670391f9b', 'request_id': 'req-b68cdead-c2ef-4f92-bdf2-6bde612226b6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.657908 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc479f0f1a7a4ad0847c5e2670391f9b', 'request_id': 'req-b68cdead-c2ef-4f92-bdf2-6bde612226b6'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.670324 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] The token cache is being invalidate because project fc479f0f1a7a4ad0847c5e2670391f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:09.670616 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.671237 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.673341 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1409/2806] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:09 2022] DELETE /identity/v3/projects/fc479f0f1a7a4ad0847c5e2670391f9b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:09.677247 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:09.686657 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41683f1a-3b90-40a5-8e65-9dc6f8d9aab3 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:09.741421 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:09.742349 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:09.742581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:09.742860 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] PATH_INFO: `/v3/users/d91f5b48176149ff829a4cdd80d777cf` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:09.744080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91f5b48176149ff829a4cdd80d777cf)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:09.746010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:09.789984 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91f5b48176149ff829a4cdd80d777cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.796927 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91f5b48176149ff829a4cdd80d777cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.808922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91f5b48176149ff829a4cdd80d777cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.809560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91f5b48176149ff829a4cdd80d777cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.816784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91f5b48176149ff829a4cdd80d777cf'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:09.822603 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1398/2807] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:12:09 2022] DELETE /identity/v3/users/d91f5b48176149ff829a4cdd80d777cf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:10.079715 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:10.081170 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:10.096317 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cdead-c2ef-4f92-bdf2-6bde612226b6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:10.152109 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:10.152970 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.153251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.153524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] PATH_INFO: `/v3/projects/c6afd583890f47f3aa3efcd0309b9d31` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.154672 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6afd583890f47f3aa3efcd0309b9d31)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:10.156607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:10.199480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6afd583890f47f3aa3efcd0309b9d31', 'request_id': 'req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.206241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6afd583890f47f3aa3efcd0309b9d31', 'request_id': 'req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.211452 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6afd583890f47f3aa3efcd0309b9d31', 'request_id': 'req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.223146 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] The token cache is being invalidate because project c6afd583890f47f3aa3efcd0309b9d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:10.223456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.224129 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.225650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1410/2808] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:10 2022] DELETE /identity/v3/projects/c6afd583890f47f3aa3efcd0309b9d31 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:10.229686 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:10.231074 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:10.244034 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908687-ffda-4211-a6f2-15df754ce9c9 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:10.297361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:10.298132 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.298415 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.298692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] PATH_INFO: `/v3/users/d44beea5c984474ea67a7c38983965f2` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.299890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44beea5c984474ea67a7c38983965f2)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:10.301797 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:10.345702 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44beea5c984474ea67a7c38983965f2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.352483 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44beea5c984474ea67a7c38983965f2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.363610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44beea5c984474ea67a7c38983965f2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.364263 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44beea5c984474ea67a7c38983965f2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.370671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-f9e41765-7f30-47bb-9c1d-809f26b02694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44beea5c984474ea67a7c38983965f2'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.376821 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1399/2809] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:12:10 2022] DELETE /identity/v3/users/d44beea5c984474ea67a7c38983965f2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:10.636961 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:10.638497 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:10.651259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3aa9d-ae1f-401f-8a5d-52bf283f9282 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:10.706729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:10.707602 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.707886 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.708161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] PATH_INFO: `/v3/projects/c6fc27b00b074461ace587e077e1cc3d` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.709313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6fc27b00b074461ace587e077e1cc3d)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:10.711198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:10.754741 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6fc27b00b074461ace587e077e1cc3d', 'request_id': 'req-6593f297-38c2-4f6e-9a69-4034175dc6c0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.760718 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6fc27b00b074461ace587e077e1cc3d', 'request_id': 'req-6593f297-38c2-4f6e-9a69-4034175dc6c0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.765962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6fc27b00b074461ace587e077e1cc3d', 'request_id': 'req-6593f297-38c2-4f6e-9a69-4034175dc6c0'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.778232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] The token cache is being invalidate because project c6fc27b00b074461ace587e077e1cc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:10.778519 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.779156 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6593f297-38c2-4f6e-9a69-4034175dc6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:10.780686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1411/2810] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:10 2022] DELETE /identity/v3/projects/c6fc27b00b074461ace587e077e1cc3d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:10.787296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.787616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.787922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.805717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:10.806918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:10.866350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1400/2811] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:10.874643 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.874935 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.875217 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.893960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:10.895152 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:10.903241 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1412/2812] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:10.907288 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:10.917020 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f0faf-79f6-4a76-866d-195b5d542445 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:10.921972 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:10.922629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.922914 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.923192 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.923947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:12:10.924257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:10.925851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:10.937311 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1401/2813] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:12:10.942292 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:10.951188 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2e2e4-f6d0-44ef-a812-a9b9cddd3af6 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:10.956569 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:10.957205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:10.957488 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:10.957789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:10.958459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:10.960379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:10.984360 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1413/2814] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:10 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:10.988428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:10.998161 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8265bf83-d3b9-4951-9840-dd5bfd849b12 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:11.054080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:11.054080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:11.054080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:11.054080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:11.054606 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:11.056513 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:11.076097 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1402/2815] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:10 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:11.081054 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:11.092302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a577-cb4f-4701-839d-2f32f41cd03d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:11.097213 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:11.097864 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:11.098149 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:11.098423 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:11.099140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:11.100947 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:11.111123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1414/2816] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:11.114985 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:11.125142 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07059c-eacf-4271-b205-347de7605875 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:11.130196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed22f47-2a44-411e-b8f1-95889086856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:11.130871 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed22f47-2a44-411e-b8f1-95889086856d admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:11.131156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed22f47-2a44-411e-b8f1-95889086856d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:11.131433 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed22f47-2a44-411e-b8f1-95889086856d admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:11.132400 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed22f47-2a44-411e-b8f1-95889086856d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:11.133980 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed22f47-2a44-411e-b8f1-95889086856d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:11.144093 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1403/2817] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:11.148151 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:11.157804 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48668e-4798-4bda-9dab-128fcedde5cc admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:11.162365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:11.163224 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:11.163516 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:11.163823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] PATH_INFO: `/v3/projects/6c78db9f424245168281e5665a4b7ef0/users/d714d4b82fbc43349512decb8f18d46e/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:11.177725 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c78db9f424245168281e5665a4b7ef0, user_id=d714d4b82fbc43349512decb8f18d46e, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:11.180416 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:11.192981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1415/2818] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:11 2022] PUT /identity/v3/projects/6c78db9f424245168281e5665a4b7ef0/users/d714d4b82fbc43349512decb8f18d46e/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:12:11.204394 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:11.204694 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:11.204982 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:11.230379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] MFA Rules not processed for user `d714d4b82fbc43349512decb8f18d46e`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:11.231668 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:11.293881 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1404/2819] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:11.305769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:11.307479 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:11.361739 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa578be-53a4-4f62-8fbf-b6055a76b15c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:11.365487 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26764d-8b37-42fe-a1eb-a3c5fe2e7f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:11.366123 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26764d-8b37-42fe-a1eb-a3c5fe2e7f0b service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:11.366401 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26764d-8b37-42fe-a1eb-a3c5fe2e7f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:11.366673 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26764d-8b37-42fe-a1eb-a3c5fe2e7f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:11.374754 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26764d-8b37-42fe-a1eb-a3c5fe2e7f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:11.376842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26764d-8b37-42fe-a1eb-a3c5fe2e7f0b service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:11.385103 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1416/2820] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:32.832948 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:32.891631 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719c46f-e495-4dba-b17d-f4b39b1c4a35 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:32.896049 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:32.896898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:32.897180 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:32.897454 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] PATH_INFO: `/v3/users/d714d4b82fbc43349512decb8f18d46e` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:32.898624 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d714d4b82fbc43349512decb8f18d46e)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:32.900568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:32.949026 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd714d4b82fbc43349512decb8f18d46e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:32.957333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd714d4b82fbc43349512decb8f18d46e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:32.968717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd714d4b82fbc43349512decb8f18d46e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:32.969404 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd714d4b82fbc43349512decb8f18d46e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:32.977707 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd714d4b82fbc43349512decb8f18d46e'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:32.984224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1405/2821] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:12:32 2022] DELETE /identity/v3/users/d714d4b82fbc43349512decb8f18d46e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:32.988750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:32.989233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:32.989339 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.006220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:33.007451 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:33.063189 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1417/2822] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:33.072837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.074224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:33.129314 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ab00c-149f-4f80-af3b-e4d18c6e47e0 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.132933 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614d98e-d910-497a-a1d8-6a9146d7b57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.133567 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614d98e-d910-497a-a1d8-6a9146d7b57c service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.133851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614d98e-d910-497a-a1d8-6a9146d7b57c service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.134130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614d98e-d910-497a-a1d8-6a9146d7b57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.142913 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614d98e-d910-497a-a1d8-6a9146d7b57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.144867 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614d98e-d910-497a-a1d8-6a9146d7b57c service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.154005 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1406/2823] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:33.404334 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.405765 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:33.417812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c89a6-8ef3-4f35-9d77-fd38a47d6f79 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.422608 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.423472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.423794 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.424061 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] PATH_INFO: `/v3/projects/6c78db9f424245168281e5665a4b7ef0` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.425887 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c78db9f424245168281e5665a4b7ef0)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.427945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.472964 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c78db9f424245168281e5665a4b7ef0', 'request_id': 'req-fef56d38-0550-4905-ba88-e1cee581aa35'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:33.479098 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c78db9f424245168281e5665a4b7ef0', 'request_id': 'req-fef56d38-0550-4905-ba88-e1cee581aa35'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:33.484459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c78db9f424245168281e5665a4b7ef0', 'request_id': 'req-fef56d38-0550-4905-ba88-e1cee581aa35'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:33.496524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] The token cache is being invalidate because project 6c78db9f424245168281e5665a4b7ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:33.496736 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:33.497370 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-fef56d38-0550-4905-ba88-e1cee581aa35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:33.498869 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1418/2824] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:33 2022] DELETE /identity/v3/projects/6c78db9f424245168281e5665a4b7ef0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:33.503700 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.503993 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.504298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.521250 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:33.522444 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:33.586774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1407/2825] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:33.645121 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.645408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.645686 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.663917 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:33.665087 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:33.672894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1419/2826] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:33.677564 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.687179 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43afba-e215-4d61-98e4-76729604ae31 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.691786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.692434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.692724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.693004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.693724 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:12:33.694052 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.695651 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.707671 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1408/2827] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:12:33.711683 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.720751 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00220f3-596f-4181-a5b0-02e620f8b765 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.725907 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.726542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.726822 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.727095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.727819 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.729704 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.756559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1420/2828] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:33 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:12:33.758846 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.769424 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6d909-f6f8-4513-8b30-0bec0bdae0ec admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.822059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.822722 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.823004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.823281 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.824006 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.825908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.845637 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1409/2829] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:33 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:33.850229 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.860335 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec65d1-8d92-471c-ad58-6c821906d88c admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.864810 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.865459 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.865738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.866009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.866727 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.868350 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.878269 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1421/2830] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:33.882018 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.891612 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da982cc-c871-4a37-9c7b-e257cc2c4de7 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.896692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc3cfa-d2c3-4521-92d4-ffebcf67839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.897362 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3cfa-d2c3-4521-92d4-ffebcf67839a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.897650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3cfa-d2c3-4521-92d4-ffebcf67839a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.897929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc3cfa-d2c3-4521-92d4-ffebcf67839a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.898644 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc3cfa-d2c3-4521-92d4-ffebcf67839a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.900268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc3cfa-d2c3-4521-92d4-ffebcf67839a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.910338 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1410/2831] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:33.914236 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:33.924057 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601e2da-78d5-4466-ae2a-5734c7c509cf admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:33.928726 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:33.929621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.929930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.930205 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] PATH_INFO: `/v3/projects/af8e07a44cc1460e8f326ecc241f8d98/users/568012e41af54113870d75bbea07b824/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:33.944231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8e07a44cc1460e8f326ecc241f8d98, user_id=568012e41af54113870d75bbea07b824, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:33.946916 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:33.964542 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1422/2832] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:33 2022] PUT /identity/v3/projects/af8e07a44cc1460e8f326ecc241f8d98/users/568012e41af54113870d75bbea07b824/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:33.974891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:33.975186 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:33.975473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:34.000824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] MFA Rules not processed for user `568012e41af54113870d75bbea07b824`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:34.002004 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:34.061721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1411/2833] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:34.072425 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:34.074124 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:34.128713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd14c34-a6de-41e0-9a48-5087ab2c8110 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:34.132310 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980234b-49c4-44d2-bc32-0b0164b53596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:34.132949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980234b-49c4-44d2-bc32-0b0164b53596 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:34.133233 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980234b-49c4-44d2-bc32-0b0164b53596 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:34.133514 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980234b-49c4-44d2-bc32-0b0164b53596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:34.141524 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980234b-49c4-44d2-bc32-0b0164b53596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:34.142972 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980234b-49c4-44d2-bc32-0b0164b53596 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:34.152107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1423/2834] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:37.073044 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:37.132922 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028ac4b-0fce-4891-aca5-21d8a3f49381 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:37.137359 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:37.138220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.138501 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.138775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] PATH_INFO: `/v3/users/568012e41af54113870d75bbea07b824` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.139964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568012e41af54113870d75bbea07b824)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:37.141895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:37.186134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568012e41af54113870d75bbea07b824'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.193333 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568012e41af54113870d75bbea07b824'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.204947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568012e41af54113870d75bbea07b824'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.205600 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568012e41af54113870d75bbea07b824'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.212084 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568012e41af54113870d75bbea07b824'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.217814 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1412/2835] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:12:37 2022] DELETE /identity/v3/users/568012e41af54113870d75bbea07b824 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:37.222962 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.223456 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.223594 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.240407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:37.241586 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:37.297419 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1424/2836] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:37.307710 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:37.309113 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:37.363858 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ade6c-94d2-4399-b7f9-4c4581282192 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:37.367478 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542981-c573-4280-b977-251003835d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:37.368140 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542981-c573-4280-b977-251003835d9c service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.368434 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542981-c573-4280-b977-251003835d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.368711 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542981-c573-4280-b977-251003835d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.377420 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542981-c573-4280-b977-251003835d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:37.378877 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c542981-c573-4280-b977-251003835d9c service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:37.388010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1413/2837] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:37.643480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:37.644956 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:37.656526 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf488b-ca75-4696-b4c3-5c34d598353b None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:37.661441 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:37.662298 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.662580 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.662854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] PATH_INFO: `/v3/projects/af8e07a44cc1460e8f326ecc241f8d98` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.664058 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8e07a44cc1460e8f326ecc241f8d98)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:37.665975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:37.711052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8e07a44cc1460e8f326ecc241f8d98', 'request_id': 'req-ed40839b-987c-4d33-a39e-18af00a4b591'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.716882 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8e07a44cc1460e8f326ecc241f8d98', 'request_id': 'req-ed40839b-987c-4d33-a39e-18af00a4b591'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.722078 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8e07a44cc1460e8f326ecc241f8d98', 'request_id': 'req-ed40839b-987c-4d33-a39e-18af00a4b591'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.733622 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] The token cache is being invalidate because project af8e07a44cc1460e8f326ecc241f8d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:12:37.733912 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.734527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-ed40839b-987c-4d33-a39e-18af00a4b591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:12:37.736100 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1425/2838] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:12:37 2022] DELETE /identity/v3/projects/af8e07a44cc1460e8f326ecc241f8d98 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:37.741812 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.742107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.742387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.760364 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:37.761566 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:37.818451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1414/2839] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:37.826063 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.826302 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.826588 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.845478 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:37.846662 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:37.854394 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1426/2840] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:37.858548 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:37.867870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4b747-882e-4b97-8d0d-7c9ca8ae1256 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:37.872382 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:37.873019 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.873298 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.873569 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.874273 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:12:37.874575 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:37.876188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:37.887656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1415/2841] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:12:37.891703 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:37.901266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f1b03-27cc-485d-8477-faa0ca26ea81 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:37.905836 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:37.906476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:37.906759 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:37.907035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:37.907747 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:37.909674 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:37.934261 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1427/2842] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:37 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:37.938395 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:37.948699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f47bf-1594-4e6c-862e-581ff5debff8 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:38.001361 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:38.002022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:38.002307 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:38.002581 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:38.003784 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:38.005687 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:38.026028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1416/2843] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:37 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:12:38.030200 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:38.040392 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd279-9e7d-4982-bc74-dc66458b03a1 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:38.045035 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:38.045687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:38.045976 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:38.046257 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:38.046981 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:38.048617 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:38.058780 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1428/2844] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:38.062535 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:38.072951 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7061d1-3e4b-405d-8e7d-1d6bbd8e020d admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:38.077656 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5284f9c-58f1-4766-802f-9b3436441508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:38.078254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284f9c-58f1-4766-802f-9b3436441508 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:38.078524 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284f9c-58f1-4766-802f-9b3436441508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:38.078803 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284f9c-58f1-4766-802f-9b3436441508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:38.079553 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5284f9c-58f1-4766-802f-9b3436441508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:38.081435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5284f9c-58f1-4766-802f-9b3436441508 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:38.091898 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1417/2845] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:38.096043 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:38.105750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f760e9d-8176-48df-9eec-c5d3dce7cd29 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:38.110303 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:38.111169 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:38.111455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:38.111771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] PATH_INFO: `/v3/projects/3250fc24af40437b91fca618c525dc20/users/970a6f3d46414d0499c23dece85a3fcc/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:38.127987 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3250fc24af40437b91fca618c525dc20, user_id=970a6f3d46414d0499c23dece85a3fcc, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:38.132060 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:38.145589 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1429/2846] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:38 2022] PUT /identity/v3/projects/3250fc24af40437b91fca618c525dc20/users/970a6f3d46414d0499c23dece85a3fcc/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:38.150503 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f26a-e1d6-4e0e-9410-6f1e5a925a73 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:38.150820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f26a-e1d6-4e0e-9410-6f1e5a925a73 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:38.151096 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f26a-e1d6-4e0e-9410-6f1e5a925a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:38.168423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9646f26a-e1d6-4e0e-9410-6f1e5a925a73 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:38.169596 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9646f26a-e1d6-4e0e-9410-6f1e5a925a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:38.224410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1418/2847] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:38.234015 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:38.235800 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:38.290391 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00d87b-912a-4ad9-8c4e-365b7e44e36b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:38.294211 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:38.294848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:38.295135 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:38.295414 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:38.304868 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:38.306297 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:38.315433 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1430/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:42.529435 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:42.529973 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:42.530124 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:42.558947 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] MFA Rules not processed for user `970a6f3d46414d0499c23dece85a3fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:42.560278 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:42.633103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1419/2849] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:42.637537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:42.649550 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a3786-4d87-4931-9a5a-fca1d406efc8 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:42.654679 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:42.655621 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:42.656108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:42.656382 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:42.657255 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:42.659208 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:42.689600 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1431/2850] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:12:42 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:42.693751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:42.705189 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85222-f096-46d7-9179-4feba9f52c79 None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:42.769580 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:42.770254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:42.770536 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:42.770811 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:42.771505 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:42.773446 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:42.794022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1420/2851] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:12:42 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:12:42.802839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:42.819705 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef902-af09-40d0-aafc-567407c81ab0 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:42.821079 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:42.821950 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:42.822396 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:42.822828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:42.823745 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:42.828706 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:42.843913 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1432/2852] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:42.848407 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:42.858403 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b11040-ad1b-4af1-b8b6-2a1bc68ca687 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:42.863497 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:42.865646 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:42.866174 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:42.868308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] PATH_INFO: `/v3/projects/6e26f7916330402bb1a1cdcfc334fe01/users/feb4ce3bdef649959b6320ea3543df04/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:42.887372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e26f7916330402bb1a1cdcfc334fe01, user_id=feb4ce3bdef649959b6320ea3543df04, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:42.890114 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:42.904353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1421/2853] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:42 2022] PUT /identity/v3/projects/6e26f7916330402bb1a1cdcfc334fe01/users/feb4ce3bdef649959b6320ea3543df04/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:12:42.908281 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:42.918348 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07890314-e216-47db-a36e-d59eece1cce6 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:42.978352 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a54655-2622-42ff-814f-8cd214402cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:42.979125 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a54655-2622-42ff-814f-8cd214402cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:42.979481 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a54655-2622-42ff-814f-8cd214402cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:42.979860 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a54655-2622-42ff-814f-8cd214402cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:42.980606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a54655-2622-42ff-814f-8cd214402cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:42.982226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a54655-2622-42ff-814f-8cd214402cc4 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:42.993346 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1433/2854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:12:42.997472 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:43.008733 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06b4e6-98d1-4c31-8279-1397076e7b92 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:43.013997 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:43.014897 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:43.015183 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:43.015465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] PATH_INFO: `/v3/projects/6e26f7916330402bb1a1cdcfc334fe01/users/feb4ce3bdef649959b6320ea3543df04/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:43.018303 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e26f7916330402bb1a1cdcfc334fe01, user_id=feb4ce3bdef649959b6320ea3543df04, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:43.021059 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:43.034449 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1422/2855] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:12:42 2022] PUT /identity/v3/projects/6e26f7916330402bb1a1cdcfc334fe01/users/feb4ce3bdef649959b6320ea3543df04/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:12:47.339041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c61ab-d094-42be-a350-2ca416615326 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:47.339443 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c61ab-d094-42be-a350-2ca416615326 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:47.339631 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c61ab-d094-42be-a350-2ca416615326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:47.366482 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-260c61ab-d094-42be-a350-2ca416615326 None None] MFA Rules not processed for user `feb4ce3bdef649959b6320ea3543df04`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:47.367658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-260c61ab-d094-42be-a350-2ca416615326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:47.434973 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1434/2856] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:12:47.446178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:12:47.447884 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:47.548761 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fdf7a-ef77-48e4-bd6b-8d7934025bb1 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:12:47.555178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:12:47.555862 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:47.556150 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:47.556428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:47.615251 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:12:47.618491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:12:47.628753 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1423/2857] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:12:49.882670 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:12:49.883154 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:12:49.883244 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:12:49.900607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] MFA Rules not processed for user `970a6f3d46414d0499c23dece85a3fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:12:49.901811 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:12:49.908812 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1435/2858] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:13:09.214316 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:13:09.215764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:13:09.271133 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc751b5-8973-4364-9db9-5e1b128d69e2 service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:13:09.274704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:13:09.275345 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:13:09.275669 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:13:09.275950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:13:09.277701 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:13:09.291200 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:13:09.292650 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:13:09.303296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1424/2859] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:13:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:13:10.005717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:13:10.060477 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a559-d523-4def-ae9e-63f688f21a22 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:13:10.064025 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:13:10.064661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:13:10.064945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:13:10.065220 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:13:10.067037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:13:10.080400 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:13:10.082099 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:13:10.093619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1436/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:13:11.554098 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:13:11.564528 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4713b-9f0c-44e4-8ab4-e1357deb2b26 service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:13:11.568254 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:13:11.568890 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:13:11.569178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:13:11.569456 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:13:11.571257 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:13:11.581921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:13:11.583412 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:13:11.592370 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1425/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:13:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:13:25.459097 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:13:25.467652 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b63c5-1864-44a4-a749-90bae4d4e78d service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:13:25.471249 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:13:25.472019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:13:25.472312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:13:25.472591 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:13:25.481862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:13:25.483293 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:13:25.492559 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1437/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:13:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:15:53.840171 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:53.841847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:53.855826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:53.857282 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:53.908902 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560a872-da8c-4ad6-945c-5aa97fc7d5bf service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:53.914268 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:53.914919 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:53.915207 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:53.915488 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:53.917301 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:53.924696 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709db98-f135-474f-a418-cc4faef7b1fe service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:53.928751 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:53.929657 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:53.930290 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:53.930414 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:53.930570 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:53.930848 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:53.939830 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:53.941388 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:53.941837 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1426/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:15:53.951274 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1438/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:15:54.433083 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:54.434463 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:54.447165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a8617-b47e-4ee6-b0d5-689c3e1ceed1 service placement] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:54.450820 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:54.451451 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:54.451763 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:54.452043 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:54.453772 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:54.463717 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:54.465131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:54.473678 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1427/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:15:54.574225 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:54.583729 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03591e69-793f-4853-8e74-33c992a6f65a service placement] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:54.587259 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:54.587920 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:54.588472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:54.588749 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:54.590517 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:54.600140 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:54.601579 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:54.609549 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1439/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:15:55.721518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:55.730007 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eb4ee-3e17-415f-b08b-5e82d010fd06 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:55.733568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:55.734196 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:55.734481 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:55.734758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:55.736494 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:55.749770 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:55.751194 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:55.762892 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1428/2867] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:15:55.849735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:55.862265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804aaa-0c38-4dba-9065-0fcf51cdd191 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:55.867181 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:55.867845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:55.868131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:55.868408 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:55.870224 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:55.881656 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:55.883243 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:55.893671 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1440/2868] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:15:57.795224 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:15:57.797351 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:57.811294 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da01d04-d450-4958-9c27-3707bf6b4b92 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:15:57.816856 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:15:57.817502 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:15:57.817794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:15:57.818076 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:15:57.819851 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:15:57.832353 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:15:57.833924 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:15:57.845709 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1429/2869] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:17:44.038769 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:44.051573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1eaf4a-20c5-4fa0-b50e-1e9de0e8378a service placement] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:44.057471 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:44.058214 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:44.058568 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:44.058921 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:44.061056 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:44.075131 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:44.076845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:44.088598 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1441/2870] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:17:47.624778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:47.636453 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b793-47f3-4c02-a4ef-f82526596c4a service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:47.641845 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:47.642482 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:47.642787 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:47.643069 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:47.652205 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:47.653794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:47.665125 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1430/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:17:48.907041 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:48.916263 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd30c7-6e1e-43b5-9513-72ad0d046a37 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:48.919826 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:48.920454 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:48.920740 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:48.921019 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:48.987095 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:48.988583 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:48.998607 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1442/2872] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:17:55.083786 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:55.094232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e78db-a135-457b-88a5-3e9193456b66 service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:55.098723 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:55.099610 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:55.099896 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:55.100172 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] PATH_INFO: `/v3/users/970a6f3d46414d0499c23dece85a3fcc` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:55.101387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=970a6f3d46414d0499c23dece85a3fcc)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:55.103287 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:55.148302 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970a6f3d46414d0499c23dece85a3fcc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.155375 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970a6f3d46414d0499c23dece85a3fcc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.168457 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970a6f3d46414d0499c23dece85a3fcc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.169323 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970a6f3d46414d0499c23dece85a3fcc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.177165 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970a6f3d46414d0499c23dece85a3fcc'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.183721 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1431/2873] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:17:55 2022] DELETE /identity/v3/users/970a6f3d46414d0499c23dece85a3fcc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:17:55.358010 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:55.369665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb529f-abb2-469d-9a02-9ac543b97582 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:55.423937 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:55.424789 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:55.425072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:55.425347 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] PATH_INFO: `/v3/projects/3250fc24af40437b91fca618c525dc20` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:55.426507 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3250fc24af40437b91fca618c525dc20)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:55.428503 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:55.473404 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3250fc24af40437b91fca618c525dc20', 'request_id': 'req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.479380 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3250fc24af40437b91fca618c525dc20', 'request_id': 'req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.484687 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3250fc24af40437b91fca618c525dc20', 'request_id': 'req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.496052 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] The token cache is being invalidate because project 3250fc24af40437b91fca618c525dc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:17:55.496340 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.496968 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.498462 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1443/2874] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:17:55 2022] DELETE /identity/v3/projects/3250fc24af40437b91fca618c525dc20 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:17:55.502419 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:55.503930 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:55.517758 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b287a1a-a752-4757-83e5-293b940c4b28 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:55.572057 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:55.572926 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:55.573209 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:55.573531 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] PATH_INFO: `/v3/users/feb4ce3bdef649959b6320ea3543df04` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:55.574720 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb4ce3bdef649959b6320ea3543df04)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:55.576696 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:55.621091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb4ce3bdef649959b6320ea3543df04'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.627859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb4ce3bdef649959b6320ea3543df04'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.639870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb4ce3bdef649959b6320ea3543df04'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.640521 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb4ce3bdef649959b6320ea3543df04'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.647080 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8151fd55-245e-482c-ac51-85b5278c2572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb4ce3bdef649959b6320ea3543df04'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.652783 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1432/2875] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:17:55 2022] DELETE /identity/v3/users/feb4ce3bdef649959b6320ea3543df04 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:17:55.831931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:55.833344 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:55.847161 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8e7b9-b831-4ae0-86fe-1a58bf53f02d admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:55.901399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:55.902251 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:55.902537 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:55.902818 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] PATH_INFO: `/v3/projects/6e26f7916330402bb1a1cdcfc334fe01` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:55.904029 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e26f7916330402bb1a1cdcfc334fe01)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:55.905932 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:55.949426 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e26f7916330402bb1a1cdcfc334fe01', 'request_id': 'req-cef3335a-f9a0-4cc8-aae5-56febb0c039a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.955313 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e26f7916330402bb1a1cdcfc334fe01', 'request_id': 'req-cef3335a-f9a0-4cc8-aae5-56febb0c039a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.961138 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e26f7916330402bb1a1cdcfc334fe01', 'request_id': 'req-cef3335a-f9a0-4cc8-aae5-56febb0c039a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.974148 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] The token cache is being invalidate because project 6e26f7916330402bb1a1cdcfc334fe01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79739) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:17:55.974437 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.975074 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-cef3335a-f9a0-4cc8-aae5-56febb0c039a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:17:55.979399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1444/2876] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:17:55 2022] DELETE /identity/v3/projects/6e26f7916330402bb1a1cdcfc334fe01 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:17:55.985152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cee02c-93de-4d19-92cf-15396659962e None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:55.985491 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cee02c-93de-4d19-92cf-15396659962e None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:55.985834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cee02c-93de-4d19-92cf-15396659962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.003152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-23cee02c-93de-4d19-92cf-15396659962e None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:17:56.004377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-23cee02c-93de-4d19-92cf-15396659962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:56.061368 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1433/2877] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:17:56.069026 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.069319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.069596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.093224 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:17:56.094424 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:56.102960 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1445/2878] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 29 16:17:56.106987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cee02c-93de-4d19-92cf-15396659962e None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.116592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cee02c-93de-4d19-92cf-15396659962e None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.121229 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.121870 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.122152 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.122432 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] PATH_INFO: `/v3/domains` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.123145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79740) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 29 16:17:56.123452 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.125103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.136659 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1434/2879] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Mar 29 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 29 16:17:56.140786 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.150371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749c539-a4e5-479b-8392-0bb979ce569f None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.154991 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.155663 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.155953 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.156232 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.156925 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.158817 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.191647 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1446/2880] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:17:56 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 29 16:17:56.196178 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.205852 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4c6c7-a791-4ed4-be3e-53ebe8c2b868 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.260662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.261324 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.261613 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.261895 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.262577 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.264518 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.283051 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1435/2881] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:17:56 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:17:56.287080 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.297120 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a30dc-bb9c-4d8a-935b-1e5055b32aac admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.301730 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.302379 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.302665 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.302945 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.303734 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.305399 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.315108 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1447/2882] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:17:56.319465 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.329128 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754d106-cf1c-445a-81b2-060d4e679e02 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.333698 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0235c-2faa-4c55-a9f7-599a5a65721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.334347 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0235c-2faa-4c55-a9f7-599a5a65721a admin admin] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.335217 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0235c-2faa-4c55-a9f7-599a5a65721a admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.335510 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0235c-2faa-4c55-a9f7-599a5a65721a admin admin] PATH_INFO: `/v3/roles` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.336255 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0235c-2faa-4c55-a9f7-599a5a65721a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.337840 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0235c-2faa-4c55-a9f7-599a5a65721a admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.347834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1436/2883] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:17:56.351453 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.361312 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375187c-3ab3-460a-a5d3-e5eefdf40736 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.365805 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.366659 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] REQUEST_METHOD: `PUT` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.366940 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.367210 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] PATH_INFO: `/v3/projects/0f37d952f876465086305fb72e287864/users/4f3a4430e1ce4b62b8c13c48e8a9b13b/roles/393e0469706749d1a4f1b2494247edea` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.381047 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f37d952f876465086305fb72e287864, user_id=4f3a4430e1ce4b62b8c13c48e8a9b13b, role_id=393e0469706749d1a4f1b2494247edea)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.384192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.396511 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1448/2884] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:17:56 2022] PUT /identity/v3/projects/0f37d952f876465086305fb72e287864/users/4f3a4430e1ce4b62b8c13c48e8a9b13b/roles/393e0469706749d1a4f1b2494247edea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:17:56.401987 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465bdd6-632a-4c47-aae6-e19b0e7a91a6 None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.402284 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465bdd6-632a-4c47-aae6-e19b0e7a91a6 None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.402568 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465bdd6-632a-4c47-aae6-e19b0e7a91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.419620 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-9465bdd6-632a-4c47-aae6-e19b0e7a91a6 None None] MFA Rules not processed for user `dd0ca27a61b54e5fb3070d05e2a206c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:17:56.420806 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9465bdd6-632a-4c47-aae6-e19b0e7a91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:56.477016 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1437/2885] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:17:56.486446 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:17:56.488136 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:17:56.542684 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797fe1-4027-4f26-b51d-94def23751af admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:17:56.546265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:17:56.546894 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:17:56.547173 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:17:56.547449 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:17:56.556658 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:17:56.558082 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:17:56.567122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1449/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:00.680259 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:00.680704 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:00.681021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:00.711635 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] MFA Rules not processed for user `4f3a4430e1ce4b62b8c13c48e8a9b13b`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:18:00.712859 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:00.782609 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1438/2887] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:18:00.787071 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:00.796695 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5f8a-8600-4fc5-b937-8c17ac5a02c5 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:00.801359 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:00.802011 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:00.802333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:00.802619 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:00.803373 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:00.805278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:00.839114 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1450/2888] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Mar 29 16:18:00 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:18:00.840402 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:00.852103 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d189156-cdc4-4201-9cb5-0c1b290f942a None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:00.909514 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:00.910185 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:00.910468 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:00.910743 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] PATH_INFO: `/v3/users` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:00.911469 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:00.913473 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:00.933053 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1439/2889] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Mar 29 16:18:00 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 29 16:18:00.937001 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:00.948271 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d5b6d-7b65-4a38-82a4-aca42c478b0a admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:00.952989 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:00.953655 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:00.953942 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:00.954221 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:00.954949 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:00.956606 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:00.985862 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1451/2890] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:18:00.989732 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:01.000639 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e6729-3a51-431d-b203-8301ac63f866 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:01.005350 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:01.006218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:01.007131 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:01.007550 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] PATH_INFO: `/v3/projects/6c7a7785b65845239f11f7b80e04a88a/users/0af8dde60760436b9785046d6cf9982a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:01.025911 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7a7785b65845239f11f7b80e04a88a, user_id=0af8dde60760436b9785046d6cf9982a, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:01.029010 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:01.044487 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1440/2891] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:18:00 2022] PUT /identity/v3/projects/6c7a7785b65845239f11f7b80e04a88a/users/0af8dde60760436b9785046d6cf9982a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:18:01.048676 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:01.059738 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614604f6-a597-4b25-95ff-38cc57d35756 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:01.118661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e111a-0b13-417c-894b-8b9fe77543f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:01.119333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e111a-0b13-417c-894b-8b9fe77543f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:01.119650 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e111a-0b13-417c-894b-8b9fe77543f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:01.119928 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e111a-0b13-417c-894b-8b9fe77543f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:01.120666 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e111a-0b13-417c-894b-8b9fe77543f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:01.122307 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e111a-0b13-417c-894b-8b9fe77543f1 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:01.133017 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1452/2892] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Mar 29 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 29 16:18:01.137206 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:01.148064 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3564e-4e80-415b-a13b-88bbe7d0d1da admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:01.153091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:01.153981 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] REQUEST_METHOD: `PUT` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:01.154269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:01.154551 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] PATH_INFO: `/v3/projects/6c7a7785b65845239f11f7b80e04a88a/users/0af8dde60760436b9785046d6cf9982a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:01.156891 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7a7785b65845239f11f7b80e04a88a, user_id=0af8dde60760436b9785046d6cf9982a, role_id=ea99f201bccb4d7c9187bd6b6d4e25ed)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:01.159563 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:01.171666 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1441/2893] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Mar 29 16:18:01 2022] PUT /identity/v3/projects/6c7a7785b65845239f11f7b80e04a88a/users/0af8dde60760436b9785046d6cf9982a/roles/ea99f201bccb4d7c9187bd6b6d4e25ed => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 29 16:18:05.573226 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fbd25-fa09-4e47-803a-47f530d83a85 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:05.573717 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fbd25-fa09-4e47-803a-47f530d83a85 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:05.574009 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fbd25-fa09-4e47-803a-47f530d83a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:05.605735 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-925fbd25-fa09-4e47-803a-47f530d83a85 None None] MFA Rules not processed for user `0af8dde60760436b9785046d6cf9982a`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:18:05.607037 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-925fbd25-fa09-4e47-803a-47f530d83a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:05.675476 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1453/2894] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:18:05.687242 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:05.689024 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:05.761864 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9200bb5-1557-49d2-94b9-fc8c522edceb admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:05.767708 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:05.768618 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:05.768908 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:05.769191 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:05.823387 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:05.825017 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:05.834211 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1442/2895] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:26.417315 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:26.417825 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:26.417939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:26.434896 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] MFA Rules not processed for user `4f3a4430e1ce4b62b8c13c48e8a9b13b`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:18:26.436113 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:26.442771 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1454/2896] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:18:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:18:26.478410 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:26.479824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:26.554218 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b4976-18d5-48a6-a5e5-8314735dc88c service nova] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:26.557779 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:26.558413 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:26.558699 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:26.558978 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:26.560801 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:26.574614 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:26.576021 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:26.586955 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1443/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:26.864086 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:26.919073 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d881c43-511c-4a7c-8ace-0db934fadc70 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:26.922632 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:26.923267 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:26.923573 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:26.923854 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:26.925623 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:26.935371 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:26.936832 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:26.945428 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1455/2898] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:27.383379 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:27.384759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:27.395841 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf528-c18b-4154-863c-ab445cc2f3ed service cinder] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:27.399923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:27.400555 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:27.400843 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:27.401123 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:27.403028 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:27.417136 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:27.418565 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:27.433214 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1444/2899] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:28.965713 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:28.975322 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2b3b9-37c2-43dd-8107-e51f35f450de service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:28.979028 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:28.979707 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:28.979993 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:28.980278 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:28.982472 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:28.992777 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:28.994231 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:29.002931 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1456/2900] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:42.799759 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:42.808154 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1dbb0e-afbe-4a45-840b-8021fc36aea5 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:42.811776 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:42.812409 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:42.812697 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:42.812977 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:42.822458 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:42.823923 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:42.833070 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1445/2901] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:18:44.389480 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:18:44.393791 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:44.414198 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1823e1-d746-4b78-9111-8c5fc32a6670 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:18:44.419758 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:18:44.420406 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:18:44.420694 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:18:44.420979 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:18:44.422743 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:18:44.435455 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:18:44.437072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4d0ab-cb9e-4c28-a53f-b8f425f873ed service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:18:44.447661 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1457/2902] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:18:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:21:00.868486 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:21:00.870095 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:21:00.987589 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550c7e8-ca41-4998-80c0-39437b31975a service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:21:00.992517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:21:00.993157 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:21:00.993437 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:21:00.993775 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:21:00.995517 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:21:01.007411 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:21:01.009022 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:21:01.019756 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1446/2903] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:21:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:21:02.352951 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] REQUEST_METHOD: `POST` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:21:02.353420 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:21:02.353527 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:21:02.371697 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.auth.core [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] MFA Rules not processed for user `4f3a4430e1ce4b62b8c13c48e8a9b13b`. Rule list: `[]` (Enabled: `True`). {{(pid=79739) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:21:02.372895 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:21:02.379839 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1458/2904] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:21:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:21:02.695950 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:21:02.705662 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ed669-9fe1-4f9e-9c3d-8aa65cecf8d1 service placement] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:21:02.709221 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:21:02.710475 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:21:02.710764 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:21:02.711048 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:21:02.712824 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:21:02.723319 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:21:02.724778 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:21:02.732586 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1447/2905] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:21:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:21:04.170752 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:21:04.182466 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617a6f1-675b-4e4a-8c48-d96ea09d6649 None None] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:21:04.187294 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:21:04.187954 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:21:04.188235 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:21:04.188508 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:21:04.190224 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:21:04.201693 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:21:04.203265 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:21:04.213004 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1459/2906] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:21:19.270629 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:21:19.284813 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a84855-7112-464e-a9e3-f6a83ff860b2 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:21:19.290348 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:21:19.290991 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:21:19.291277 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:21:19.291590 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:21:19.293372 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:21:19.305406 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:21:19.306989 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a32d50-52d1-40a2-99a9-be396fe8bd9f service nova] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:21:19.317448 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1448/2907] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:23:10.693190 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:23:10.694603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:23:10.725528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd883a-95d9-4ba1-b3f6-52ae10e7695c service placement] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:23:10.729159 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f956c2a9dfbd40fbabd043c371e579e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:23:10.729807 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:23:10.730093 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:23:10.730375 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:23:10.738615 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:23:10.740094 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:23:10.749122 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1460/2908] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:23:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:23:21.685235 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] REQUEST_METHOD: `POST` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:23:21.685765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:23:21.685872 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:23:21.704023 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.auth.core [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] MFA Rules not processed for user `4f3a4430e1ce4b62b8c13c48e8a9b13b`. Rule list: `[]` (Enabled: `True`). {{(pid=79740) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 29 16:23:21.705796 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:23:21.712595 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1449/2909] 10.222.0.23 () {58 vars in 957 bytes} [Tue Mar 29 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 29 16:23:24.626596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:23:24.678930 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7319ccf-129f-44e7-aab1-f8b0f5ea0df0 service cinder] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:23:24.685116 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:23:24.686072 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:23:24.686362 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:23:24.686640 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:23:24.688828 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:23:24.718077 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:23:24.720192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:23:24.733364 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1461/2910] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:23:27.117107 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:23:27.136341 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6ef0-1d05-4336-95eb-4a2f8112248d None None] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:23:27.139912 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:23:27.140545 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:23:27.140832 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:23:27.141130 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:23:27.151774 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:23:27.153232 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:23:27.164014 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1450/2911] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:23:28.348435 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:23:28.358596 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff91afd-319c-41bc-8d2c-20cd6dc75411 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:23:28.362192 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:23:28.362873 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:23:28.363162 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:23:28.363438 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:23:28.374814 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:23:28.376333 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:23:28.388845 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1462/2912] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:23:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:23:36.123306 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:23:36.131903 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3821-2269-43b7-87bd-66e268f5d630 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:23:36.135447 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:23:36.136112 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:23:36.136377 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:23:36.136652 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:23:36.143745 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:23:36.145156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:23:36.152847 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1451/2913] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 29 16:25:39.005952 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:25:39.019899 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9ce50-4710-4ccc-a764-4bb5c6f86771 service neutron] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:25:39.025827 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba546b8ade2443a096e7f303d609b622', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:25:39.026558 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:25:39.026901 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:25:39.027398 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:25:39.038540 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:25:39.040528 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:25:39.052714 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1463/2914] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:25:43.747195 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:25:43.756091 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3036a-dc31-4d34-ab02-793e660f0cf1 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:25:43.762423 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa8ff0744fac48fd8dca772e998701ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:25:43.763175 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:25:43.763560 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:25:43.763921 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:25:43.842390 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:25:43.843886 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:25:43.862148 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1452/2915] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:25:50.217969 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:25:50.229042 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eaffa4-49a9-4570-aaff-e3eb8cfc0ca5 service nova] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:25:50.234933 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:25:50.235823 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:25:50.236110 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:25:50.236385 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] PATH_INFO: `/v3/users/4f3a4430e1ce4b62b8c13c48e8a9b13b` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:25:50.237603 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f3a4430e1ce4b62b8c13c48e8a9b13b)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:25:50.239553 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:25:50.284407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3a4430e1ce4b62b8c13c48e8a9b13b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.285064 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3a4430e1ce4b62b8c13c48e8a9b13b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.296144 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3a4430e1ce4b62b8c13c48e8a9b13b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.303107 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3a4430e1ce4b62b8c13c48e8a9b13b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.303785 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3a4430e1ce4b62b8c13c48e8a9b13b'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.315958 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1464/2916] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:25:50 2022] DELETE /identity/v3/users/4f3a4430e1ce4b62b8c13c48e8a9b13b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:25:50.483556 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:25:50.494476 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d879c-5b3b-42a9-8c3e-c1050cbb29e6 service neutron] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:25:50.550110 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:25:50.550964 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:25:50.551244 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:25:50.551519 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] PATH_INFO: `/v3/projects/0f37d952f876465086305fb72e287864` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:25:50.552692 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f37d952f876465086305fb72e287864)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:25:50.554604 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:25:50.598156 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f37d952f876465086305fb72e287864', 'request_id': 'req-c85f7672-e153-44eb-83a2-c703cc6ac275'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.605816 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f37d952f876465086305fb72e287864', 'request_id': 'req-c85f7672-e153-44eb-83a2-c703cc6ac275'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.610940 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f37d952f876465086305fb72e287864', 'request_id': 'req-c85f7672-e153-44eb-83a2-c703cc6ac275'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.633013 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] The token cache is being invalidate because project 0f37d952f876465086305fb72e287864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:25:50.633300 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.633918 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.635428 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1453/2917] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:25:50 2022] DELETE /identity/v3/projects/0f37d952f876465086305fb72e287864 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:25:50.639306 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:25:50.640760 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:25:50.653411 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5595d1d-0678-49a1-a7d2-05166b89e73b admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:25:50.706939 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:25:50.707842 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:25:50.708130 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:25:50.708407 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] PATH_INFO: `/v3/users/0af8dde60760436b9785046d6cf9982a` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:25:50.709578 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af8dde60760436b9785046d6cf9982a)` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:25:50.711494 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:25:50.755787 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af8dde60760436b9785046d6cf9982a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.756365 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af8dde60760436b9785046d6cf9982a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.769266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af8dde60760436b9785046d6cf9982a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.776710 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af8dde60760436b9785046d6cf9982a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.777319 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.notifications [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af8dde60760436b9785046d6cf9982a'} {{(pid=79739) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:50.789075 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1465/2918] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Mar 29 16:25:50 2022] DELETE /identity/v3/users/0af8dde60760436b9785046d6cf9982a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:25:50.959269 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:25:50.960906 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:25:50.974308 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f7672-e153-44eb-83a2-c703cc6ac275 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:25:51.029834 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd0ca27a61b54e5fb3070d05e2a206c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8676a22b20704599967d071e06718ce0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:25:51.030616 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:25:51.030905 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:25:51.031188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] PATH_INFO: `/v3/projects/6c7a7785b65845239f11f7b80e04a88a` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:25:51.032399 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7a7785b65845239f11f7b80e04a88a)` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:25:51.034296 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:25:51.078522 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7a7785b65845239f11f7b80e04a88a', 'request_id': 'req-8e910435-cad9-43b9-92dc-af2184206d35'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:51.085239 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7a7785b65845239f11f7b80e04a88a', 'request_id': 'req-8e910435-cad9-43b9-92dc-af2184206d35'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:51.091146 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7a7785b65845239f11f7b80e04a88a', 'request_id': 'req-8e910435-cad9-43b9-92dc-af2184206d35'} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:51.101835 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] The token cache is being invalidate because project 6c7a7785b65845239f11f7b80e04a88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79740) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 29 16:25:51.102134 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:51.102765 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.notifications [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79740) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 29 16:25:51.104367 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1454/2919] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Mar 29 16:25:50 2022] DELETE /identity/v3/projects/6c7a7785b65845239f11f7b80e04a88a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 29 16:26:05.921266 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Authenticating user token {{(pid=79739) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:26:05.922642 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:26:05.988946 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb73585-bd93-4aba-ac09-448cae1c4b89 admin admin] Validating token access rules against request {{(pid=79739) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:26:06.045178 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79739) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:26:06.045750 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] REQUEST_METHOD: `GET` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:26:06.046034 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] SCRIPT_NAME: `/identity` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:26:06.046308 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79739) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:26:06.048445 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.fernet_utils [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79739) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:26:06.060403 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:26:06.061975 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74824ab9-100c-4cf9-87ea-02dd7af60d9d service placement] RBAC: Authorization granted {{(pid=79739) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:26:06.071581 dv-cinder-808995-2-iscsi devstack@keystone.service[79739]: [pid: 79739|app: 0|req: 1466/2920] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 29 16:31:10.829794 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Authenticating user token {{(pid=79740) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 29 16:31:10.831339 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.fernet_utils [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79740) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 29 16:31:10.898145 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910435-cad9-43b9-92dc-af2184206d35 admin admin] Validating token access rules against request {{(pid=79740) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 29 16:31:10.903220 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f5c63-c6bb-4d10-a30e-28d3406e837f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43182ee871284e7c919f8dfc4f39fa79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ce31a148ff44bd98a0c1f1e2c5a172b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79740) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 29 16:31:10.903894 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f5c63-c6bb-4d10-a30e-28d3406e837f service placement] REQUEST_METHOD: `GET` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 29 16:31:10.904181 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f5c63-c6bb-4d10-a30e-28d3406e837f service placement] SCRIPT_NAME: `/identity` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 29 16:31:10.904466 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f5c63-c6bb-4d10-a30e-28d3406e837f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79740) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 29 16:31:10.913188 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f5c63-c6bb-4d10-a30e-28d3406e837f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 29 16:31:10.914929 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f5c63-c6bb-4d10-a30e-28d3406e837f service placement] RBAC: Authorization granted {{(pid=79740) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 29 16:31:10.925592 dv-cinder-808995-2-iscsi devstack@keystone.service[79740]: [pid: 79740|app: 0|req: 1455/2921] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Mar 29 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)